-- Logs begin at Sun 2022-10-16 00:10:34 UTC, end at Sun 2022-10-16 01:14:28 UTC. -- Oct 16 00:48:47.827680 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Oct 16 00:48:50.433932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.common.config [-] Logging enabled! Oct 16 00:48:50.434706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 21.1.0.dev82 Oct 16 00:48:50.434847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=105601) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Oct 16 00:48:50.435590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Oct 16 00:48:50.958579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO keyring.backend [-] Loading KWallet Oct 16 00:48:50.966755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO keyring.backend [-] Loading SecretService Oct 16 00:48:50.970473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO keyring.backend [-] Loading Windows Oct 16 00:48:50.971849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO keyring.backend [-] Loading chainer Oct 16 00:48:50.972639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO keyring.backend [-] Loading macOS Oct 16 00:48:51.627633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.628201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.628634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.631624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.631624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.631931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.715913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.716514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.716997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.727530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.728137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.728604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.755503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.756016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.756450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.798634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.799156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:51.799565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:52.019451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Oct 16 00:48:52.020797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Oct 16 00:48:52.021939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Oct 16 00:48:52.022564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Oct 16 00:48:52.023229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Oct 16 00:48:52.023821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Oct 16 00:48:52.025258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:48:52.031177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.031667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.031667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.031667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.031858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.032159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.032263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.032553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.032802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.033138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.033911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.033911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.033911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.034091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.034268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.034471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.034738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.035271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.035655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.035920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.036194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.036459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.036734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.037003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.037256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.037508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.037764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.038086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-master-3-iscsi {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.038336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.038613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.038897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.039157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.039550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.039822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.040080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.040325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.040570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.040813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.041073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.041324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.041578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.041787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.041977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.042307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.043947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.043947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.043947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.044380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.044537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.044717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.044957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.045215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.045470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.045797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.046006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.046210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.046503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.046734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.046992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.047241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.047531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.047739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.048048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.048278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.048502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.048702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.048999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.049218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.049455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.049757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.050039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.050238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.050422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.050635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.050848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.051244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.051398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.051959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.051959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.052423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:48:52.052423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.052697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.053312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.053312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.053600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.053747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.053911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.054148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.054367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.054623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.054915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.055156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.055426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.055684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.055948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.056238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.056532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.056781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.057052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.057300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.057564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.057896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.058217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.058622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.059145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.059416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.059801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.060000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.060161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.060430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.060691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.060947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.061423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.061423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.061866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.061866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.062440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.062440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.063124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.063124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.063124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.063657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.063657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.064256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.064256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.064573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.064573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.064991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.065149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.065344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.065626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.065878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.066154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.066405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.066662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.066981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.067227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.067504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.067727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.068015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.068254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.068507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.068733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.068977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.069224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.069469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.069710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.070153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.070408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.070696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.070974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.071307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.071307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.072139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.072139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.072139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.073250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.073250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.073250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.073250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.073250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.075399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.075399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.075399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.075399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.075399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.075399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.077555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.078850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.079773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.079773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.079773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.080318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.080318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.080318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.080709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.080853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.081015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.084579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.085642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.086542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.087544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.087544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.087544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.087544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.088080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.088080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.088080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.088489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.088633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.088793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.089558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.089871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.090295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.090650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.090936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.091186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.091437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.091907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.091907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.092287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.092470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.093048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.093048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.093632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.093632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.093752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.093911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.094190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.094471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.094736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.095017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.095304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.095547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.095811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.096052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.096296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.096548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.096817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.097078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.097347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.097720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.098006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.098263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.098512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.098756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.099032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.099491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.099957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.100405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.100824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.101290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.101739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.102151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.102560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.103030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.103467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.103886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.104329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.105305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.106201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.106669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.107174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.107774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.115328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.115925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.116373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.116855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.117312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.117750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.118196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.118638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.119088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.119557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.120014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.126898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.127609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.128080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.128542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.129000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.129457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.129902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.130347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.130793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.131321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.131774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:48:52.132138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=105601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:48:52.204701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=105601) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Oct 16 00:48:52.205246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=105601) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Oct 16 00:48:52.205673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=105601) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 16 00:48:52.206148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=105601) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 16 00:48:52.206566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=105601) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 16 00:48:52.207050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=105601) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Oct 16 00:48:52.277602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:52.278429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow10', 'OpenFlow13', 'OpenFlow14')) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:52.279423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:52.285644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:52.291632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=105601) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Oct 16 00:48:52.292499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.303700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=280ffcd7-0b94-4345-b52e-9d008c592e66, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.324060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=280ffcd7-0b94-4345-b52e-9d008c592e66, col_values=(('inactivity_probe', 10000),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.341057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.341918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.353678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 00009e4ff10c3f44 Oct 16 00:48:53.357779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0x1436a5f0,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.370476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1436a5f2,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.373545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1436a5f4,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.376578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x1436a5f6,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.379104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0x1436a5f8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.381509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1436a5fa,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.384719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x1436a5fc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.389053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1436a5fe,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.391593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1436a600,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:53.392203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=105601) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Oct 16 00:48:53.393055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Oct 16 00:48:53.394549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x0000e627cb76174e Oct 16 00:48:53.395853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.396438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow10', 'OpenFlow13', 'OpenFlow14')) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.397061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.410598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:53.420129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=105601) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Oct 16 00:48:53.421087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.446723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=1cc7fdcf-310d-4559-9dd6-0b780a7220ce, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.474783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=1cc7fdcf-310d-4559-9dd6-0b780a7220ce, col_values=(('inactivity_probe', 10000),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.487550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 0000e627cb76174e Oct 16 00:48:54.493303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xd17e8c71,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:54.495032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.497680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.545273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.571932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.588413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.618295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1436a602,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:54.622825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xd17e8c73,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:54.624475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.640567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:54.656726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:54.665143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:54.667234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:54.668758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:54.670587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:54.672245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:54.968812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:54.969124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:54.969402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:54.969642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:54.970272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:54.970519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:55.037599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Init firewall settings (driver=openvswitch) {{(pid=105601) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Oct 16 00:48:55.039644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow12', 'OpenFlow11')) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:48:56.058259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ac6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:56.063810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ac8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:56.072369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416aca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:56.083241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416acc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:56.087073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ace,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:48:56.088580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.ip_conntrack [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=105601) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Oct 16 00:48:56.089906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:56.092186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpoomb497u/privsep.sock'] Oct 16 00:48:56.112781 dv-cinder-master-3-iscsi sudo[107288]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpoomb497u/privsep.sock Oct 16 00:48:56.115544 dv-cinder-master-3-iscsi sudo[107288]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 16 00:48:58.359943 dv-cinder-master-3-iscsi sudo[107288]: pam_unix(sudo:session): session closed for user root Oct 16 00:48:58.370677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Spawned new privsep daemon via rootwrap Oct 16 00:48:58.371924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Accepted privsep connection to /tmp/tmpoomb497u/privsep.sock {{(pid=105601) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Oct 16 00:48:58.372985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep daemon starting Oct 16 00:48:58.373254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Oct 16 00:48:58.373541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Oct 16 00:48:58.373816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 107304 Oct 16 00:48:58.377638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2da78-3f84-4e7d-b690-261f268222ae]: (2,) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.386978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=107304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:48:59.389876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.003s {{(pid=107304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:48:59.389876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.001s {{(pid=107304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:48:59.643702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ca20f-0fcc-4a44-84a8-dedac997e065]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.644785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.658500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a82d1-32ac-4e7f-a593-287a5599fe11]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.659427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.671969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2a0218-11a7-4396-81e5-84f7f0aa28c9]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.672604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.685505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c7e4c-7e69-42da-84bd-6e7b74419844]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.686159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.699188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ef621-9d49-44af-b3de-c76370938c50]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.700327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.713337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[407728d0-c7c6-4cdc-b988-445e65c6a3fe]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.714702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.726658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a91978-b1ca-4413-9591-1ffa59fa3b4a]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.727528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.751264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c901b7-fa27-453b-8b97-010cfa8c620d]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.752094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.777999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058a590-2535-467a-8feb-8e1c15f19248]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.779010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Processing 1 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:48:59.791125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d8039d-4163-45a0-967b-b8358ec9fbba]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:48:59.791955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.793364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.793736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.794501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > Port after_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.795250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > Port after_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.796007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.796781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.899948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8787539400174'] for Open vSwitch agent (None), after_init {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:48:59.901708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Subscribe: > ovsdb after_read 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.905851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Subscribe: > Trunk before_create 55550000 {{(pid=105601) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Oct 16 00:48:59.906950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Registering callback for Trunk {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:59.907648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Registering callback for SubPort {{(pid=105601) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Oct 16 00:48:59.989341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Unregistering callback for Trunk {{(pid=105601) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Oct 16 00:48:59.990005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent initialized successfully, now running... Oct 16 00:48:59.991291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmpw7zcx9lh/privsep.sock'] Oct 16 00:49:00.004416 dv-cinder-master-3-iscsi sudo[107355]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpw7zcx9lh/privsep.sock Oct 16 00:49:00.005257 dv-cinder-master-3-iscsi sudo[107355]: pam_unix(sudo:session): session opened for user root by (uid=0) Oct 16 00:49:01.365170 dv-cinder-master-3-iscsi sudo[107355]: pam_unix(sudo:session): session closed for user root Oct 16 00:49:01.374002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Spawned new privsep daemon via rootwrap Oct 16 00:49:01.374765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Accepted privsep connection to /tmp/tmpw7zcx9lh/privsep.sock {{(pid=105601) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Oct 16 00:49:01.375581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep daemon starting Oct 16 00:49:01.375839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Oct 16 00:49:01.376094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Oct 16 00:49:01.376344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 107360 Oct 16 00:49:01.379239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f0391-859f-411b-8222-c44e4f7f7865]: (2,) {{(pid=107360) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:01.597013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=107360) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 16 00:49:01.603845 dv-cinder-master-3-iscsi ovs-vsctl[107362]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Oct 16 00:49:01.606593 dv-cinder-master-3-iscsi ovs-vsctl[107362]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Oct 16 00:49:01.608333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=107360) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 16 00:49:01.608664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad53db3-feb6-4c3f-a697-00f233d954a4]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=107360) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:01.609300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=105601) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Oct 16 00:49:01.609647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=105601) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Oct 16 00:49:01.617612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:01.618412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:0 started Oct 16 00:49:01.623880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ad0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=266000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.625508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["80d5a158-c961-44eb-a0d0-598229833ea4","initial","int-br-data",1,["map",[]]],["451188eb-172d-4a53-aec8-650ad15b1df4","initial","phy-br-data",2,["map",[]]],["cfb1d36d-6596-447c-9666-fcd41d99d834","initial","br-int",65534,["map",[]]],["117bef07-505c-4f59-bd25-4aab8eb213b2","initial","eth1",1,["map",[]]],["cb9d5b38-04da-42d0-afec-05c311c18921","initial","br-data",65534,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:01.626176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:01.626837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:0 - starting polling. Elapsed:0.009 Oct 16 00:49:01.628395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:01.629341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:0 - port information retrieved. Elapsed:0.011 Oct 16 00:49:01.629651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Cleaning stale br-int flows Oct 16 00:49:01.629974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reserved cookies for br-int: {16250737307531889450} Oct 16 00:49:01.633094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ad2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=250000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=1450,cookie=16250737307531889450,duration_nsec=15000000,duration_sec=7,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=5,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=263000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.635012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ad4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.637543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ad6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.640262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ad8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=283000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.642472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ada,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=264000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.644458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416adc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.646316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ade,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.648496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ae0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=262000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.650622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ae2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=259000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.653055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ae4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=280000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.655486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ae6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=279000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.657764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ae8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=274000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.660772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416aea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=948000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=18000000,duration_sec=2,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.662891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416aec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=6000000,duration_sec=2,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.664906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416aee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=994000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.666767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416af0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.668649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416af2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.670688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416af4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=986000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.672741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416af6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=975000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.675101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416af8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=935000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.677148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416afa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=911000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.679267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416afc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=889000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.679530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Cleaning stale br-data flows Oct 16 00:49:01.679836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reserved cookies for br-data: {3824201269964127989} Oct 16 00:49:01.682936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xd17e8c75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=3824201269964127989,duration_nsec=60000000,duration_sec=7,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=1450,cookie=3824201269964127989,duration_nsec=191000000,duration_sec=7,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=5,priority=0,table_id=0)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.684938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xd17e8c77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.686753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xd17e8c79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.688577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xd17e8c7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:01.688908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:0 - cleanup stale flows. Elapsed:0.071 Oct 16 00:49:01.689265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.071 Oct 16 00:49:03.619532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:1 started Oct 16 00:49:03.622934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416afe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=266000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:03.623503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:03.623852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:49:05.620580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:2 started Oct 16 00:49:05.623200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=266000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:05.623775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:05.624133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:06.903838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING oslo_policy.policy [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Oct 16 00:49:06.904492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING oslo_policy.policy [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Oct 16 00:49:06.908453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:49:06Z,description='Default security group',id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,is_default=True,name='default',project_id='c3343320b0624293946f3195f2d767e2',revision_number=1,rules=[SecurityGroupRule(0580ba7b-aec1-443a-9f74-17fc1b81b202),SecurityGroupRule(08d0eb4c-26d4-41a7-ade2-faba27e74888),SecurityGroupRule(481715ea-3d60-49ea-bb6d-87b932b6a5fe),SecurityGroupRule(4e21bab2-17cc-4008-801a-75e59b83ef81)],shared=False,stateful=True,updated_at=2022-10-16T00:49:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:06.908866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:06.909514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:06Z,description=,direction='ingress',ethertype='IPv6',id=0580ba7b-aec1-443a-9f74-17fc1b81b202,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3343320b0624293946f3195f2d767e2',protocol=,remote_address_group_id=,remote_group_id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,remote_ip_prefix=,revision_number=0,security_group_id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,updated_at=2022-10-16T00:49:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:06.909885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0580ba7b-aec1-443a-9f74-17fc1b81b202), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:06.910260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Security group rule updated ['e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63'] Oct 16 00:49:06.911045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:06Z,description=,direction='egress',ethertype='IPv4',id=08d0eb4c-26d4-41a7-ade2-faba27e74888,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3343320b0624293946f3195f2d767e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,updated_at=2022-10-16T00:49:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:06.911377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (08d0eb4c-26d4-41a7-ade2-faba27e74888), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:06.911711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Security group rule updated ['e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63'] Oct 16 00:49:06.912386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:06Z,description=,direction='ingress',ethertype='IPv4',id=481715ea-3d60-49ea-bb6d-87b932b6a5fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3343320b0624293946f3195f2d767e2',protocol=,remote_address_group_id=,remote_group_id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,remote_ip_prefix=,revision_number=0,security_group_id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,updated_at=2022-10-16T00:49:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:06.912748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (481715ea-3d60-49ea-bb6d-87b932b6a5fe), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:06.913082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Security group rule updated ['e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63'] Oct 16 00:49:06.913745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:06Z,description=,direction='egress',ethertype='IPv6',id=4e21bab2-17cc-4008-801a-75e59b83ef81,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3343320b0624293946f3195f2d767e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63,updated_at=2022-10-16T00:49:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:06.914103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4e21bab2-17cc-4008-801a-75e59b83ef81), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:06.914436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Security group rule updated ['e7a0fcc0-0d6b-4c8e-864c-75c54d9f3a63'] Oct 16 00:49:07.063111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:49:06Z,description='',dns_domain=None,id=5efafd86-4caf-40e2-821d-20031dd04013,mtu=1500,name='private',project_id='c3343320b0624293946f3195f2d767e2',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5efafd86-4caf-40e2-821d-20031dd04013),segments=[NetworkSegment(a968f30f-7be2-4446-813a-3c357e3c50b3)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:49:06Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:07.063619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (5efafd86-4caf-40e2-821d-20031dd04013), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-bcbcb5d1-cfe8-4468-94f0-04aaa201da7a demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5efafd86-4caf-40e2-821d-20031dd04013 with segmentation id not found. Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:49:07.204750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:49:07.205666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:49:07.205666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:49:07.205666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:49:07.205666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5efafd86-4caf-40e2-821d-20031dd04013 with segmentation id not found. Oct 16 00:49:07.205666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:49:07.621790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:3 started Oct 16 00:49:07.624495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=267000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:07.625066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:07.625422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:09.623001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:4 started Oct 16 00:49:09.625474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=268000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:09.626034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:09.626389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:10.757771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e109bbcc-7938-42e7-8f5d-9d0397276e29 demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(023d6fb7-e81b-480b-bef8-3288a9c3f48b)],cidr=172.20.0.0/26,created_at=2022-10-16T00:49:10Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=9da71c92-a90b-4efc-8731-9d2297b9ab1a,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=5efafd86-4caf-40e2-821d-20031dd04013,project_id='c3343320b0624293946f3195f2d767e2',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='6a4b78c0-9058-4d02-a42e-89e050a35e70',updated_at=2022-10-16T00:49:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:10.758421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e109bbcc-7938-42e7-8f5d-9d0397276e29 demo admin] Publish callbacks [] for Subnet (9da71c92-a90b-4efc-8731-9d2297b9ab1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:11.623628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:5 started Oct 16 00:49:11.626258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=269000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:11.626879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:11.627243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:11.768995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d33e4715-8415-4f40-91bf-5c87fa81546d None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:49:11Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5efafd86-4caf-40e2-821d-20031dd04013',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fe94c5f2-dc80-4270-a160-f6fab75a087e,mac_address=fa:16:3e:ed:46:72,name='',network_id=5efafd86-4caf-40e2-821d-20031dd04013,numa_affinity_policy=,project_id='c3343320b0624293946f3195f2d767e2',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fe94c5f2-dc80-4270-a160-f6fab75a087e),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:49:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:11.769586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d33e4715-8415-4f40-91bf-5c87fa81546d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fe94c5f2-dc80-4270-a160-f6fab75a087e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:12.026188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d33e4715-8415-4f40-91bf-5c87fa81546d None None] Resource Port fe94c5f2-dc80-4270-a160-f6fab75a087e updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fe94c5f2-dc80-4270-a160-f6fab75a087e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fe94c5f2-dc80-4270-a160-f6fab75a087e,segment=NetworkSegment(a968f30f-7be2-4446-813a-3c357e3c50b3),segment_id=a968f30f-7be2-4446-813a-3c357e3c50b3)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fe94c5f2-dc80-4270-a160-f6fab75a087e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:12.026832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d33e4715-8415-4f40-91bf-5c87fa81546d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fe94c5f2-dc80-4270-a160-f6fab75a087e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:13.624938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:6 started Oct 16 00:49:13.627977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=270000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:13.628287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:13.628627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:6 - starting polling. Elapsed:0.004 Oct 16 00:49:13.630012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:13.631846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:6 - port information retrieved. Elapsed:0.007 Oct 16 00:49:13.632199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:49:15.625741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:7 started Oct 16 00:49:15.628161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=271000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:15.628738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:15.629101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:17.626544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:8 started Oct 16 00:49:17.633130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=273000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:17.633736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:17.634100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:49:18.937698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["354c83ca-3e22-49e4-87c6-494d60fd782b","insert","tapfe94c5f2-dc",["set",[]],["map",[["attached-mac","fa:16:3e:ed:46:72"],["iface-id","fe94c5f2-dc80-4270-a160-f6fab75a087e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:18.946945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["354c83ca-3e22-49e4-87c6-494d60fd782b","old",null,["set",[]],null],["","new","tapfe94c5f2-dc",2,["map",[["attached-mac","fa:16:3e:ed:46:72"],["iface-id","fe94c5f2-dc80-4270-a160-f6fab75a087e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:19.627848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:9 started Oct 16 00:49:19.630405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=273000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:19.631057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:19.631533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:9 - starting polling. Elapsed:0.004 Oct 16 00:49:19.632498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:19.633356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:9 - port information retrieved. Elapsed:0.006 Oct 16 00:49:19.633688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e'}, 'added': {'fe94c5f2-dc80-4270-a160-f6fab75a087e'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:49:19.634298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5efafd86-4caf-40e2-821d-20031dd04013', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'mac_address': 'fa:16:3e:ed:46:72', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:49:19.635730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: fe94c5f2-dc80-4270-a160-f6fab75a087e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:49:19.636073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port fe94c5f2-dc80-4270-a160-f6fab75a087e updated. Details: {'device': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5efafd86-4caf-40e2-821d-20031dd04013', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'mac_address': 'fa:16:3e:ed:46:72', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:49:19.636435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 1 as local vlan for net-id=5efafd86-4caf-40e2-821d-20031dd04013, seg-id=372 Oct 16 00:49:19.640450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c7d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4468), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:19.642704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416b10,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4468}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:19.644331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe94c5f2-dc, col_values=(('tag', 1),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:19.644331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfe94c5f2-dc, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:19.644787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfe94c5f2-dc, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:19.651185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe94c5f2-dc, col_values=(('other_config', {'net_uuid': '5efafd86-4caf-40e2-821d-20031dd04013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '372'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:19.659819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416b12,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:19.660218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:9 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.026 Oct 16 00:49:19.660749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:49:19.661792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'fe94c5f2-dc80-4270-a160-f6fab75a087e'} Oct 16 00:49:19.663312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:49:19.663600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:49:19.665406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:49:19.705700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e04c35f-2bbf-418d-bcf1-5864e5b475a9]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:19.706340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:9 - agent port security group processed in 0.072 Oct 16 00:49:19.706962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for fe94c5f2-dc80-4270-a160-f6fab75a087e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:49:19.981241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['fe94c5f2-dc80-4270-a160-f6fab75a087e'] and devices down [] completed. Oct 16 00:49:19.981889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:9 - ports processed. Elapsed:0.354 Oct 16 00:49:19.982103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.354 Oct 16 00:49:20.040295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port fe94c5f2-dc80-4270-a160-f6fab75a087e updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:20.041283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fe94c5f2-dc80-4270-a160-f6fab75a087e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:21.629639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:10 started Oct 16 00:49:21.632216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=275000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:21.632779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:21.633119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:10 - starting polling. Elapsed:0.004 Oct 16 00:49:21.634074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:21.635477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:10 - port information retrieved. Elapsed:0.006 Oct 16 00:49:21.635793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e'}, 'added': set(), 'removed': set(), 'updated': {'fe94c5f2-dc80-4270-a160-f6fab75a087e'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:49:21.636349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5efafd86-4caf-40e2-821d-20031dd04013', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'mac_address': 'fa:16:3e:ed:46:72', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:49:21.637141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: fe94c5f2-dc80-4270-a160-f6fab75a087e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:49:21.637460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port fe94c5f2-dc80-4270-a160-f6fab75a087e updated. Details: {'device': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5efafd86-4caf-40e2-821d-20031dd04013', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'mac_address': 'fa:16:3e:ed:46:72', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 16 00:49:21.638448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe94c5f2-dc, col_values=(('tag', 1),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:21.638853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfe94c5f2-dc, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:21.639259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfe94c5f2-dc, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:21.639687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:49:21.640412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfe94c5f2-dc, col_values=(('other_config', {'net_uuid': '5efafd86-4caf-40e2-821d-20031dd04013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '372', 'tag': '1'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:21.641071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:49:21.643143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416b16,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:21.643478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:10 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.007 Oct 16 00:49:21.643825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:49:21.644115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:49:21.645260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:49:21.645548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:49:21.647115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:49:21.683126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[1328054a-b7c1-4974-bfb6-49dd8cb34eda]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:21.683664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:10 - agent port security group processed in 0.048 Oct 16 00:49:21.684234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for fe94c5f2-dc80-4270-a160-f6fab75a087e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:49:21.831126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['fe94c5f2-dc80-4270-a160-f6fab75a087e'] and devices down [] completed. Oct 16 00:49:21.831481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:10 - ports processed. Elapsed:0.202 Oct 16 00:49:21.831823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.202 Oct 16 00:49:23.630521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:11 started Oct 16 00:49:23.633167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=276000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:23.633780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:23.634302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:25.631320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:12 started Oct 16 00:49:25.633876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=277000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:25.634511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:25.635035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:26.702078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:49:26Z,description='Default security group',id=2ddf483e-6fd7-416d-80eb-fefc91482923,is_default=True,name='default',project_id='f1d89d5c90cd4c35b26fbcfc82450844',revision_number=1,rules=[SecurityGroupRule(3fee6b43-3f1e-455d-b4d3-8fd7376f9a03),SecurityGroupRule(a8dd78c5-b891-4423-9ca5-5767e1b22e1e),SecurityGroupRule(bbf02951-36bc-4d55-bb5c-5d0dd86c6a3c),SecurityGroupRule(ca3f9e06-e211-4244-9c31-8abad94f3fc0)],shared=False,stateful=True,updated_at=2022-10-16T00:49:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:26.702763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2ddf483e-6fd7-416d-80eb-fefc91482923), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:26.703209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:26Z,description=,direction='ingress',ethertype='IPv4',id=3fee6b43-3f1e-455d-b4d3-8fd7376f9a03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1d89d5c90cd4c35b26fbcfc82450844',protocol=,remote_address_group_id=,remote_group_id=2ddf483e-6fd7-416d-80eb-fefc91482923,remote_ip_prefix=,revision_number=0,security_group_id=2ddf483e-6fd7-416d-80eb-fefc91482923,updated_at=2022-10-16T00:49:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:26.703579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3fee6b43-3f1e-455d-b4d3-8fd7376f9a03), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:26.703953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Security group rule updated ['2ddf483e-6fd7-416d-80eb-fefc91482923'] Oct 16 00:49:26.704718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:26Z,description=,direction='egress',ethertype='IPv6',id=a8dd78c5-b891-4423-9ca5-5767e1b22e1e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1d89d5c90cd4c35b26fbcfc82450844',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ddf483e-6fd7-416d-80eb-fefc91482923,updated_at=2022-10-16T00:49:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:26.705014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a8dd78c5-b891-4423-9ca5-5767e1b22e1e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:26.705348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Security group rule updated ['2ddf483e-6fd7-416d-80eb-fefc91482923'] Oct 16 00:49:26.706024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:26Z,description=,direction='ingress',ethertype='IPv6',id=bbf02951-36bc-4d55-bb5c-5d0dd86c6a3c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1d89d5c90cd4c35b26fbcfc82450844',protocol=,remote_address_group_id=,remote_group_id=2ddf483e-6fd7-416d-80eb-fefc91482923,remote_ip_prefix=,revision_number=0,security_group_id=2ddf483e-6fd7-416d-80eb-fefc91482923,updated_at=2022-10-16T00:49:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:26.706386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bbf02951-36bc-4d55-bb5c-5d0dd86c6a3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:26.706716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Security group rule updated ['2ddf483e-6fd7-416d-80eb-fefc91482923'] Oct 16 00:49:26.707401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:49:26Z,description=,direction='egress',ethertype='IPv4',id=ca3f9e06-e211-4244-9c31-8abad94f3fc0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1d89d5c90cd4c35b26fbcfc82450844',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ddf483e-6fd7-416d-80eb-fefc91482923,updated_at=2022-10-16T00:49:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:26.707776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ca3f9e06-e211-4244-9c31-8abad94f3fc0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:26.708088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Security group rule updated ['2ddf483e-6fd7-416d-80eb-fefc91482923'] Oct 16 00:49:26.907159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:49:26Z,description='',dns_domain=None,id=208c62ac-592a-4dec-a1cf-31599d23bbee,mtu=1500,name='public',project_id='f1d89d5c90cd4c35b26fbcfc82450844',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(208c62ac-592a-4dec-a1cf-31599d23bbee),segments=[NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:49:26Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:26.907585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9100d559-93f3-4bf4-8f43-8053176d3451 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (208c62ac-592a-4dec-a1cf-31599d23bbee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:27.632007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:13 started Oct 16 00:49:27.634946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=278000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:27.635524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:27.635888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:29.632778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:14 started Oct 16 00:49:29.635861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=278000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:29.636457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:29.636819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:31.332815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-43a92efb-7dca-4d4a-8b67-80dc3e39d356 demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:49:30Z,data_plane_status=None,description='',device_id='6a898afe-a7f0-40b8-a677-dda16778c84b',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ed38c648-5564-48a0-9570-e3a7eef6b8a2,mac_address=fa:16:3e:50:97:df,name='',network_id=5efafd86-4caf-40e2-821d-20031dd04013,numa_affinity_policy=,project_id='c3343320b0624293946f3195f2d767e2',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ed38c648-5564-48a0-9570-e3a7eef6b8a2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:49:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:31.332815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-43a92efb-7dca-4d4a-8b67-80dc3e39d356 demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ed38c648-5564-48a0-9570-e3a7eef6b8a2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:31.634793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:15 started Oct 16 00:49:31.637496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=281000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:31.638084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:31.638485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:15 - starting polling. Elapsed:0.005 Oct 16 00:49:31.639507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:31.640364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:15 - port information retrieved. Elapsed:0.006 Oct 16 00:49:31.640698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:49:31.765740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-43a92efb-7dca-4d4a-8b67-80dc3e39d356 demo admin] Received resource Port update without any changes: ed38c648-5564-48a0-9570-e3a7eef6b8a2 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 00:49:33.596247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6dfc25b-25b2-4663-9d89-b48724ffc532 None None] Resource Port ed38c648-5564-48a0-9570-e3a7eef6b8a2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=ed38c648-5564-48a0-9570-e3a7eef6b8a2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ed38c648-5564-48a0-9570-e3a7eef6b8a2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:33.597088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6dfc25b-25b2-4663-9d89-b48724ffc532 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ed38c648-5564-48a0-9570-e3a7eef6b8a2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:33.635528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:16 started Oct 16 00:49:33.638000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=281000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:33.638689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:33.639123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:16 - starting polling. Elapsed:0.004 Oct 16 00:49:33.640230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:33.641249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:16 - port information retrieved. Elapsed:0.006 Oct 16 00:49:33.641669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:49:33.894525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6dfc25b-25b2-4663-9d89-b48724ffc532 None None] Resource Port ed38c648-5564-48a0-9570-e3a7eef6b8a2 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ed38c648-5564-48a0-9570-e3a7eef6b8a2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ed38c648-5564-48a0-9570-e3a7eef6b8a2,segment=NetworkSegment(a968f30f-7be2-4446-813a-3c357e3c50b3),segment_id=a968f30f-7be2-4446-813a-3c357e3c50b3)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ed38c648-5564-48a0-9570-e3a7eef6b8a2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:33.894886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6dfc25b-25b2-4663-9d89-b48724ffc532 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ed38c648-5564-48a0-9570-e3a7eef6b8a2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:35.636414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:17 started Oct 16 00:49:35.639074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=282000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:35.640020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:35.640435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:17 - starting polling. Elapsed:0.004 Oct 16 00:49:35.641533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:35.642463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:17 - port information retrieved. Elapsed:0.006 Oct 16 00:49:35.642994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:49:35.683690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b8523a30-73ea-423d-ac3b-39555f65bd15 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(8279a690-922f-4def-a501-7565c6c6bd3c)],cidr=172.37.2.0/24,created_at=2022-10-16T00:49:35Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.37.2.1,host_routes=[],id=f389a4ac-f37a-4f23-8d43-f4bb31e23900,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,project_id='f1d89d5c90cd4c35b26fbcfc82450844',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:49:35Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:35.684068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b8523a30-73ea-423d-ac3b-39555f65bd15 admin admin] Publish callbacks [] for Subnet (f389a4ac-f37a-4f23-8d43-f4bb31e23900), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:37.638652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:18 started Oct 16 00:49:37.642048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=284000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:37.642882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:37.644148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:49:39.087696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["140d5ad8-79e2-46e3-ae0d-848ee75f6bdb","insert","qr-ed38c648-55",["set",[]],["map",[["attached-mac","fa:16:3e:50:97:df"],["iface-id","ed38c648-5564-48a0-9570-e3a7eef6b8a2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:39.105977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["140d5ad8-79e2-46e3-ae0d-848ee75f6bdb","old",null,["set",[]],null],["","new","qr-ed38c648-55",3,["map",[["attached-mac","fa:16:3e:50:97:df"],["iface-id","ed38c648-5564-48a0-9570-e3a7eef6b8a2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:39.640637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:19 started Oct 16 00:49:39.643339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=286000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:39.643936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:39.644412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.004 Oct 16 00:49:39.645463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:39.646532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.006 Oct 16 00:49:39.646839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2'}, 'added': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:49:39.647439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'mac_address': 'fa:16:3e:50:97:df', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:49:39.648374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ed38c648-5564-48a0-9570-e3a7eef6b8a2 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:49:39.648698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ed38c648-5564-48a0-9570-e3a7eef6b8a2 updated. Details: {'device': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'mac_address': 'fa:16:3e:50:97:df', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 16 00:49:39.650576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed38c648-55, col_values=(('tag', 1),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:39.651039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-ed38c648-55, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:39.651463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-ed38c648-55, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:39.659261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed38c648-55, col_values=(('other_config', {'net_uuid': '5efafd86-4caf-40e2-821d-20031dd04013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '372'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:39.666117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416b2a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:39.666525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:19 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.019 Oct 16 00:49:39.666992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:49:39.667311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'ed38c648-5564-48a0-9570-e3a7eef6b8a2'} Oct 16 00:49:39.668688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:49:39.668855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:49:39.670705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:49:39.708193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe57934-23b9-4815-96d1-bd6cfb2e3594]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:39.708827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:19 - agent port security group processed in 0.062 Oct 16 00:49:39.709407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ed38c648-5564-48a0-9570-e3a7eef6b8a2 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:49:39.883027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ed38c648-5564-48a0-9570-e3a7eef6b8a2'] and devices down [] completed. Oct 16 00:49:39.883956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:19 - ports processed. Elapsed:0.243 Oct 16 00:49:39.884400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.244 Oct 16 00:49:39.937855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port ed38c648-5564-48a0-9570-e3a7eef6b8a2 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:39.938339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ed38c648-5564-48a0-9570-e3a7eef6b8a2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:40.122206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-957c9c17-d70c-4fdf-a97e-e935718572e7 demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:49:39Z,data_plane_status=None,description='',device_id='6a898afe-a7f0-40b8-a677-dda16778c84b',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ba42d6fc-7741-4305-8222-15c7960340e2,mac_address=fa:16:3e:84:08:6f,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ba42d6fc-7741-4305-8222-15c7960340e2),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:49:39Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:49:40.123120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-957c9c17-d70c-4fdf-a97e-e935718572e7 demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ba42d6fc-7741-4305-8222-15c7960340e2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:41.641650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:20 started Oct 16 00:49:41.645420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=288000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:41.646482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:41.647060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.006 Oct 16 00:49:41.648394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:41.650561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.009 Oct 16 00:49:41.651046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2'}, 'added': set(), 'removed': set(), 'updated': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:49:41.651731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'mac_address': 'fa:16:3e:50:97:df', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:49:41.652931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ed38c648-5564-48a0-9570-e3a7eef6b8a2 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:49:41.653371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ed38c648-5564-48a0-9570-e3a7eef6b8a2 updated. Details: {'device': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '5efafd86-4caf-40e2-821d-20031dd04013', 'port_id': 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'mac_address': 'fa:16:3e:50:97:df', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 372, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9da71c92-a90b-4efc-8731-9d2297b9ab1a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Oct 16 00:49:41.654553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed38c648-55, col_values=(('tag', 1),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:41.655124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-ed38c648-55, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:41.655762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-ed38c648-55, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:41.656219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:49:41.657075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-ed38c648-55, col_values=(('other_config', {'net_uuid': '5efafd86-4caf-40e2-821d-20031dd04013', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '372', 'tag': '1'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:41.657771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:49:41.660223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416b2e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:41.660717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:20 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.009 Oct 16 00:49:41.661094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:49:41.661394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:49:41.662598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:49:41.662920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:49:41.665235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:49:41.724927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[099788a9-632a-46df-a5db-e2efad73f94a]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:41.726023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:20 - agent port security group processed in 0.075 Oct 16 00:49:41.726709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ed38c648-5564-48a0-9570-e3a7eef6b8a2 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:49:42.129420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ed38c648-5564-48a0-9570-e3a7eef6b8a2'] and devices down [] completed. Oct 16 00:49:42.129768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:20 - ports processed. Elapsed:0.488 Oct 16 00:49:42.130117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.489 Oct 16 00:49:42.323758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20781fa8-e2b3-42dc-9a21-22d0d91fa76b None None] Resource Port ba42d6fc-7741-4305-8222-15c7960340e2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ba42d6fc-7741-4305-8222-15c7960340e2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ba42d6fc-7741-4305-8222-15c7960340e2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:42.324149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20781fa8-e2b3-42dc-9a21-22d0d91fa76b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ba42d6fc-7741-4305-8222-15c7960340e2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:42.508971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20781fa8-e2b3-42dc-9a21-22d0d91fa76b None None] Resource Port ba42d6fc-7741-4305-8222-15c7960340e2 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ba42d6fc-7741-4305-8222-15c7960340e2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ba42d6fc-7741-4305-8222-15c7960340e2,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ba42d6fc-7741-4305-8222-15c7960340e2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:42.509749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20781fa8-e2b3-42dc-9a21-22d0d91fa76b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ba42d6fc-7741-4305-8222-15c7960340e2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:42.871154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c76078da-5735-4c39-97b0-43a50c6a6e3a","insert","qg-ba42d6fc-77",["set",[]],["map",[["attached-mac","fa:16:3e:84:08:6f"],["iface-id","ba42d6fc-7741-4305-8222-15c7960340e2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:42.901851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c76078da-5735-4c39-97b0-43a50c6a6e3a","old",null,["set",[]],null],["","new","qg-ba42d6fc-77",4,["map",[["attached-mac","fa:16:3e:84:08:6f"],["iface-id","ba42d6fc-7741-4305-8222-15c7960340e2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:49:43.643179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:21 started Oct 16 00:49:43.646741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=289000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:43.648146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:43.649246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.006 Oct 16 00:49:43.651350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:43.652715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.010 Oct 16 00:49:43.653214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2'}, 'added': {'ba42d6fc-7741-4305-8222-15c7960340e2'}, 'removed': set(), 'updated': {'ba42d6fc-7741-4305-8222-15c7960340e2'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:49:43.654226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'mac_address': 'fa:16:3e:84:08:6f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:49:43.656077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ba42d6fc-7741-4305-8222-15c7960340e2 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:49:43.656584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ba42d6fc-7741-4305-8222-15c7960340e2 updated. Details: {'device': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'mac_address': 'fa:16:3e:84:08:6f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:49:43.657076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 2 as local vlan for net-id=208c62ac-592a-4dec-a1cf-31599d23bbee, seg-id=None Oct 16 00:49:43.660929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xd17e8c7f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:43.666523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x79416b32,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:43.668710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba42d6fc-77, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:43.669943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ba42d6fc-77, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:43.671831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ba42d6fc-77, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:43.682543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba42d6fc-77, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:43.692169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416b34,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:43.692712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.039 Oct 16 00:49:43.693231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:49:43.693845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'ba42d6fc-7741-4305-8222-15c7960340e2'} Oct 16 00:49:43.695179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:49:43.695559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:49:43.697579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:49:43.738602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb4bd2-7800-4dcd-9484-fef6486f85cd]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:43.739294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:21 - agent port security group processed in 0.086 Oct 16 00:49:43.741225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ba42d6fc-7741-4305-8222-15c7960340e2 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:49:43.934456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ba42d6fc-7741-4305-8222-15c7960340e2'] and devices down [] completed. Oct 16 00:49:43.935464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.293 Oct 16 00:49:43.935988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.293 Oct 16 00:49:43.993466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port ba42d6fc-7741-4305-8222-15c7960340e2 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ba42d6fc-7741-4305-8222-15c7960340e2,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ba42d6fc-7741-4305-8222-15c7960340e2,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:49:43.993869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ba42d6fc-7741-4305-8222-15c7960340e2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:45.644831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:22 started Oct 16 00:49:45.649707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=291000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:45.650066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:45.651538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:22 - starting polling. Elapsed:0.006 Oct 16 00:49:45.652908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:49:45.654256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:22 - port information retrieved. Elapsed:0.010 Oct 16 00:49:45.654650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2'}, 'added': set(), 'removed': set(), 'updated': {'ba42d6fc-7741-4305-8222-15c7960340e2'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:49:45.655429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'mac_address': 'fa:16:3e:84:08:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:49:45.656579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ba42d6fc-7741-4305-8222-15c7960340e2 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:49:45.656968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ba42d6fc-7741-4305-8222-15c7960340e2 updated. Details: {'device': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'device_id': '6a898afe-a7f0-40b8-a677-dda16778c84b', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ba42d6fc-7741-4305-8222-15c7960340e2', 'mac_address': 'fa:16:3e:84:08:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.15'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:49:45.658025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba42d6fc-77, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:45.658448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ba42d6fc-77, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:45.658967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ba42d6fc-77, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:45.659331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:49:45.660052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ba42d6fc-77, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:49:45.660685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:49:45.663088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416b38,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:45.663438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:22 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.008 Oct 16 00:49:45.663790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:49:45.664088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:49:45.666244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:49:45.666534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:49:45.668658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:49:45.732147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49ec275-d4b0-4b2e-8ccf-db4accdd2876]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:49:45.732996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:22 - agent port security group processed in 0.078 Oct 16 00:49:45.733868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ba42d6fc-7741-4305-8222-15c7960340e2 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:49:45.902151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ba42d6fc-7741-4305-8222-15c7960340e2'] and devices down [] completed. Oct 16 00:49:45.902474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:22 - ports processed. Elapsed:0.258 Oct 16 00:49:45.902818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.258 Oct 16 00:49:47.646684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:23 started Oct 16 00:49:47.656219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=293000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:47.657367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:47.657938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 00:49:49.647586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:24 started Oct 16 00:49:49.651825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=293000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:49.651825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:49.651825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:51.650558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:25 started Oct 16 00:49:51.654141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=296000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:51.655229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:51.655902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:49:53.651397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:26 started Oct 16 00:49:53.653914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=297000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:53.654468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:53.654829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:49:55.651961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:27 started Oct 16 00:49:55.660127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=299000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:55.661033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:55.661697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 00:49:57.657018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:28 started Oct 16 00:49:57.659645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=300000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:57.659645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:57.659645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:49:59.655439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:29 started Oct 16 00:49:59.658293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=301000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:49:59.658887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:49:59.659244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:01.656124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:30 started Oct 16 00:50:01.659813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=302000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:01.660652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:01.661227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:03.657022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:31 started Oct 16 00:50:03.661879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=304000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:03.664637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:03.665708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 00:50:05.658323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:32 started Oct 16 00:50:05.661837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=304000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:05.662579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:05.663705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:07.660335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:33 started Oct 16 00:50:07.665302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=306000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:07.666060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:07.666519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:50:09.663191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:34 started Oct 16 00:50:09.667844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=310000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:09.668976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:09.669727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:50:11.664449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:35 started Oct 16 00:50:11.668148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=311000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:11.668891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:11.669411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:13.665562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:36 started Oct 16 00:50:13.671535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=314000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:13.672554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:13.673264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:50:15.666301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:37 started Oct 16 00:50:15.669264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=312000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:15.670691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:15.671309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:17.668831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:38 started Oct 16 00:50:17.672411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=315000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:17.673588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:17.674229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:50:19.670306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:39 started Oct 16 00:50:19.688059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=317000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:19.689794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:19.690632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 16 00:50:21.671963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:40 started Oct 16 00:50:21.676357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=318000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:21.677365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:21.678430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:50:23.673306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:41 started Oct 16 00:50:23.676255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=319000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:23.677007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:23.677513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:25.674155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:42 started Oct 16 00:50:25.677572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=320000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:25.678927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:25.679270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:27.675430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:43 started Oct 16 00:50:27.680685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=322000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:27.681728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:27.682402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:50:29.677480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:44 started Oct 16 00:50:29.680444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=323000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:29.681007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:29.681364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:31.680328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:45 started Oct 16 00:50:31.682796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=325000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:31.683697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:31.684291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:33.680200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:46 started Oct 16 00:50:33.685933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=326000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:33.686893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:33.687429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:50:35.681305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:47 started Oct 16 00:50:35.688909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=328000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:35.691224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:35.691936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 00:50:37.683917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:48 started Oct 16 00:50:37.690043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=330000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:37.690835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:37.691364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:50:39.685177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:49 started Oct 16 00:50:39.694136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=334000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:39.694980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:39.695501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 00:50:41.686629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:50 started Oct 16 00:50:41.691186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=333000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:41.692038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:41.692553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:50:43.688031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:51 started Oct 16 00:50:43.690778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=333000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:43.691898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:43.692465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:45.688933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:52 started Oct 16 00:50:45.692625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=335000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:45.693359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:45.693799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:47.691075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:53 started Oct 16 00:50:47.693470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=336000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:47.694299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:47.694758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:49.692898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:54 started Oct 16 00:50:49.695887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=338000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:49.696482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:49.696848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:51.694006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:55 started Oct 16 00:50:51.696693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=340000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:51.697403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:51.698026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:53.694623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:56 started Oct 16 00:50:53.697081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=340000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:53.697734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:53.698133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:50:55.695301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:57 started Oct 16 00:50:55.703032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=341000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:55.703892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:55.704267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 00:50:57.696877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:58 started Oct 16 00:50:57.700150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=342000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:57.700920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:57.701484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:50:59.699143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:59 started Oct 16 00:50:59.701894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=345000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:50:59.702485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:50:59.703042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:01.699766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:60 started Oct 16 00:51:01.702613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=345000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:01.703205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:01.703566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:03.700692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:61 started Oct 16 00:51:03.703463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=346000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:03.704068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:03.704439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:05.702015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:62 started Oct 16 00:51:05.704516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=348000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:05.705085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:05.705446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:07.703534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:63 started Oct 16 00:51:07.705974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=349000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:07.706531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:07.706911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:09.705436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:64 started Oct 16 00:51:09.708877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=351000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:09.709521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:09.709880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:51:11.706229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:65 started Oct 16 00:51:11.709008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=352000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:11.709659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:11.710038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:13.707388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:66 started Oct 16 00:51:13.709926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=353000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:13.710556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:13.710925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:15.708802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:67 started Oct 16 00:51:15.711481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=354000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:15.712055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:15.712414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:17.710555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:68 started Oct 16 00:51:17.713051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=356000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:17.713616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:17.713976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:19.712737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:69 started Oct 16 00:51:19.715240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=358000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:19.715815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:19.716180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:20.843372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fffa89c9-1399-4487-bcc7-1da33845851e admin admin] Resource Subnet 9da71c92-a90b-4efc-8731-9d2297b9ab1a updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=9da71c92-a90b-4efc-8731-9d2297b9ab1a), DNSNameServer(address='8.8.4.4',order=1,subnet_id=9da71c92-a90b-4efc-8731-9d2297b9ab1a)]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:51:20.844080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fffa89c9-1399-4487-bcc7-1da33845851e admin admin] Publish callbacks [] for Subnet (9da71c92-a90b-4efc-8731-9d2297b9ab1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:51:21.713341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:70 started Oct 16 00:51:21.715788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=359000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:21.716379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:21.716776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:23.714088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:71 started Oct 16 00:51:23.716451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=359000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:23.717032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:23.717395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:25.715283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:72 started Oct 16 00:51:25.718043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=361000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:25.718648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:25.719054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:27.715757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:73 started Oct 16 00:51:27.718224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416b9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=361000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:27.718885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:27.719247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:29.716844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:74 started Oct 16 00:51:29.719276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ba0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=362000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:29.719845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:29.720200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:31.717801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:75 started Oct 16 00:51:31.720198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ba2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=363000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:31.720776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:31.721135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:33.718314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:76 started Oct 16 00:51:33.720727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ba4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=364000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:33.721287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:33.721639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:51:35.719371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:77 started Oct 16 00:51:35.721983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ba6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=365000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:35.722643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:35.723532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:37.720920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:78 started Oct 16 00:51:37.723930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ba8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=366000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:37.724497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:37.724856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:39.721425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:79 started Oct 16 00:51:39.724031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416baa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=367000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:39.724613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:39.724964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:41.722586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:80 started Oct 16 00:51:41.725759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=369000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:41.726348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:41.726707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:43.723977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:81 started Oct 16 00:51:43.726733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=370000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:43.727329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:43.727693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:45.724600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:82 started Oct 16 00:51:45.731882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=370000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:45.732475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:45.732836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:51:47.726303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:83 started Oct 16 00:51:47.728784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=372000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:47.729801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:47.730163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:49.727541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:84 started Oct 16 00:51:49.730365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=373000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:49.731415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:49.731781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:51:51.728740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:85 started Oct 16 00:51:51.731085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=374000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:51.731640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:51.731991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:53.729622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:86 started Oct 16 00:51:53.732283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=375000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:53.732876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:53.733233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:55.730078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:87 started Oct 16 00:51:55.732526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=376000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:55.733096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:55.733446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:57.730587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:88 started Oct 16 00:51:57.733175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=376000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:57.733757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:57.734120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:51:59.731602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:89 started Oct 16 00:51:59.734444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=377000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:51:59.735051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:51:59.735412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:01.732996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:90 started Oct 16 00:52:01.735822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=378000000,duration_sec=188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:01.736396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:01.736753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:03.733551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:91 started Oct 16 00:52:03.735930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=379000000,duration_sec=190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:03.736500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:03.736861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:05.734194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:92 started Oct 16 00:52:05.736749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=380000000,duration_sec=192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:05.737336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:05.737694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:07.735020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:93 started Oct 16 00:52:07.737328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=380000000,duration_sec=194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:07.737937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:07.738297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:09.735911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:94 started Oct 16 00:52:09.739430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=381000000,duration_sec=196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:09.740070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:09.740439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:52:11.736960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:95 started Oct 16 00:52:11.740250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=383000000,duration_sec=198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:11.740807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:11.741159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:13.737800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:96 started Oct 16 00:52:13.740167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=383000000,duration_sec=200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:13.740766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:13.741119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:15.738624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:97 started Oct 16 00:52:15.741056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=384000000,duration_sec=202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:15.741639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:15.741998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:17.739511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:98 started Oct 16 00:52:17.741703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=385000000,duration_sec=204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:17.742268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:17.742626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:19.739705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:99 started Oct 16 00:52:19.746548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=385000000,duration_sec=206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:19.747189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:19.747548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:52:21.740602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:100 started Oct 16 00:52:21.742943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=386000000,duration_sec=208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:21.743503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:21.743856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:22.431927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-af125f4e-3618-4902-a54c-32619631b07c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:52:22Z,description='',dns_domain=None,id=78cb0413-355e-4553-afe2-d7730c4559d0,mtu=1500,name='shared',project_id='f1d89d5c90cd4c35b26fbcfc82450844',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(78cb0413-355e-4553-afe2-d7730c4559d0),segments=[NetworkSegment(66c538ca-a052-43c4-af63-07b81c0c5e79)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:52:22Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:52:22.435309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-af125f4e-3618-4902-a54c-32619631b07c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (78cb0413-355e-4553-afe2-d7730c4559d0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-af125f4e-3618-4902-a54c-32619631b07c admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 78cb0413-355e-4553-afe2-d7730c4559d0 with segmentation id not found. Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:52:22.513829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:52:22.514906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:52:22.514906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:52:22.514906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:52:22.514906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 78cb0413-355e-4553-afe2-d7730c4559d0 with segmentation id not found. Oct 16 00:52:22.514906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:52:23.741561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:101 started Oct 16 00:52:23.744112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=387000000,duration_sec=210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:23.744685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:23.745038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:25.741940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:102 started Oct 16 00:52:25.744988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=388000000,duration_sec=212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:25.745582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:25.745939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:25.815639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e9f12efc-cd3c-420a-b048-9cf3c4c99f7c admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(0a110d63-9b54-4945-b09c-8dd996c31b77)],cidr=192.168.233.0/24,created_at=2022-10-16T00:52:25Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=5344a8b8-73a4-4476-80e2-6f951367e359,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=78cb0413-355e-4553-afe2-d7730c4559d0,project_id='f1d89d5c90cd4c35b26fbcfc82450844',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-10-16T00:52:25Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:52:25.816193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e9f12efc-cd3c-420a-b048-9cf3c4c99f7c admin admin] Publish callbacks [] for Subnet (5344a8b8-73a4-4476-80e2-6f951367e359), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:26.362242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8176a4a8-2746-4455-986b-257c748ee48d None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:52:25Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-78cb0413-355e-4553-afe2-d7730c4559d0',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=bce54c84-34e6-4b14-aaaa-8fc11edd42a4,mac_address=fa:16:3e:81:84:57,name='',network_id=78cb0413-355e-4553-afe2-d7730c4559d0,numa_affinity_policy=,project_id='f1d89d5c90cd4c35b26fbcfc82450844',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(bce54c84-34e6-4b14-aaaa-8fc11edd42a4),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:52:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:52:26.363887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8176a4a8-2746-4455-986b-257c748ee48d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (bce54c84-34e6-4b14-aaaa-8fc11edd42a4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:26.620778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8176a4a8-2746-4455-986b-257c748ee48d None None] Resource Port bce54c84-34e6-4b14-aaaa-8fc11edd42a4 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=bce54c84-34e6-4b14-aaaa-8fc11edd42a4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=bce54c84-34e6-4b14-aaaa-8fc11edd42a4,segment=NetworkSegment(66c538ca-a052-43c4-af63-07b81c0c5e79),segment_id=66c538ca-a052-43c4-af63-07b81c0c5e79)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=bce54c84-34e6-4b14-aaaa-8fc11edd42a4,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:52:26.621207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8176a4a8-2746-4455-986b-257c748ee48d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (bce54c84-34e6-4b14-aaaa-8fc11edd42a4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:26.730004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["364b71cf-6065-4d1b-ae9a-36f025ceb537","insert","tapbce54c84-34",["set",[]],["map",[["attached-mac","fa:16:3e:81:84:57"],["iface-id","bce54c84-34e6-4b14-aaaa-8fc11edd42a4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:52:26.747532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["364b71cf-6065-4d1b-ae9a-36f025ceb537","old",null,["set",[]],null],["","new","tapbce54c84-34",5,["map",[["attached-mac","fa:16:3e:81:84:57"],["iface-id","bce54c84-34e6-4b14-aaaa-8fc11edd42a4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:52:27.743022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:103 started Oct 16 00:52:27.750963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=389000000,duration_sec=214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:27.752990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:27.753935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:103 - starting polling. Elapsed:0.011 Oct 16 00:52:27.756360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:27.759515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:103 - port information retrieved. Elapsed:0.016 Oct 16 00:52:27.760156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2'}, 'added': {'bce54c84-34e6-4b14-aaaa-8fc11edd42a4'}, 'removed': set(), 'updated': {'bce54c84-34e6-4b14-aaaa-8fc11edd42a4'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:52:27.761112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-78cb0413-355e-4553-afe2-d7730c4559d0', 'network_id': '78cb0413-355e-4553-afe2-d7730c4559d0', 'port_id': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'mac_address': 'fa:16:3e:81:84:57', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 352, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5344a8b8-73a4-4476-80e2-6f951367e359', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:52:27.762655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: bce54c84-34e6-4b14-aaaa-8fc11edd42a4 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:52:27.763255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port bce54c84-34e6-4b14-aaaa-8fc11edd42a4 updated. Details: {'device': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-78cb0413-355e-4553-afe2-d7730c4559d0', 'network_id': '78cb0413-355e-4553-afe2-d7730c4559d0', 'port_id': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'mac_address': 'fa:16:3e:81:84:57', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 352, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5344a8b8-73a4-4476-80e2-6f951367e359', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:52:27.763843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 3 as local vlan for net-id=78cb0413-355e-4553-afe2-d7730c4559d0, seg-id=352 Oct 16 00:52:27.773838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d9d6272b-4498-4b0e-848a-0acc432ae2f3 None None] Resource Port bce54c84-34e6-4b14-aaaa-8fc11edd42a4 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:52:27.774230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d9d6272b-4498-4b0e-848a-0acc432ae2f3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (bce54c84-34e6-4b14-aaaa-8fc11edd42a4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:27.779193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c81,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4448), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:27.781795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416bdc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4448}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:27.782836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapbce54c84-34, col_values=(('tag', 3),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:27.783307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapbce54c84-34, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:27.784966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapbce54c84-34, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:27.793282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapbce54c84-34, col_values=(('other_config', {'net_uuid': '78cb0413-355e-4553-afe2-d7730c4559d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '352'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:27.802168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416bde,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:27.802527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:103 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.042 Oct 16 00:52:27.802959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:52:27.803483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'bce54c84-34e6-4b14-aaaa-8fc11edd42a4'} Oct 16 00:52:27.804645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:52:27.804973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:52:27.807838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:52:27.867069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[06479ea4-9b1a-44b7-9475-19d6e2cec056]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:52:27.867746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:103 - agent port security group processed in 0.107 Oct 16 00:52:27.868437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for bce54c84-34e6-4b14-aaaa-8fc11edd42a4 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:52:28.102551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['bce54c84-34e6-4b14-aaaa-8fc11edd42a4'] and devices down [] completed. Oct 16 00:52:28.102904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:103 - ports processed. Elapsed:0.360 Oct 16 00:52:28.103248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.360 Oct 16 00:52:29.744040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:104 started Oct 16 00:52:29.746656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416be0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=389000000,duration_sec=216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:29.747271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:29.747621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:104 - starting polling. Elapsed:0.004 Oct 16 00:52:29.748849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:52:29.750193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:104 - port information retrieved. Elapsed:0.006 Oct 16 00:52:29.750794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2'}, 'added': set(), 'removed': set(), 'updated': {'bce54c84-34e6-4b14-aaaa-8fc11edd42a4'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:52:29.751444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-78cb0413-355e-4553-afe2-d7730c4559d0', 'network_id': '78cb0413-355e-4553-afe2-d7730c4559d0', 'port_id': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'mac_address': 'fa:16:3e:81:84:57', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 352, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5344a8b8-73a4-4476-80e2-6f951367e359', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:52:29.752689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: bce54c84-34e6-4b14-aaaa-8fc11edd42a4 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:52:29.753024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port bce54c84-34e6-4b14-aaaa-8fc11edd42a4 updated. Details: {'device': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-78cb0413-355e-4553-afe2-d7730c4559d0', 'network_id': '78cb0413-355e-4553-afe2-d7730c4559d0', 'port_id': 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'mac_address': 'fa:16:3e:81:84:57', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 352, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5344a8b8-73a4-4476-80e2-6f951367e359', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 3} Oct 16 00:52:29.754135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapbce54c84-34, col_values=(('tag', 3),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:29.754565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapbce54c84-34, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:29.754992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapbce54c84-34, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:29.755443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:52:29.756642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapbce54c84-34, col_values=(('other_config', {'net_uuid': '78cb0413-355e-4553-afe2-d7730c4559d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '352', 'tag': '3'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:52:29.757329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:52:29.759619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416be2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:29.759969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:104 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.009 Oct 16 00:52:29.760324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:52:29.760623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:52:29.761769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:52:29.762062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:52:29.764123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:52:29.802054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0a613c-61cf-4972-85dd-e22b9c341192]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:52:29.802843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:104 - agent port security group processed in 0.052 Oct 16 00:52:29.803615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for bce54c84-34e6-4b14-aaaa-8fc11edd42a4 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:52:29.954011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['bce54c84-34e6-4b14-aaaa-8fc11edd42a4'] and devices down [] completed. Oct 16 00:52:29.954392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:104 - ports processed. Elapsed:0.211 Oct 16 00:52:29.954791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.211 Oct 16 00:52:31.745187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:105 started Oct 16 00:52:31.748337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416be4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=391000000,duration_sec=218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:31.749021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:31.749505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:52:33.746741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:106 started Oct 16 00:52:33.749185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416be6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=392000000,duration_sec=220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:33.749761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:33.750148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:35.747995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:107 started Oct 16 00:52:35.750413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416be8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=393000000,duration_sec=222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:35.751022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:35.751383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:37.749204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:108 started Oct 16 00:52:37.751744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=395000000,duration_sec=224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:37.752307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:37.752660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:39.750109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:109 started Oct 16 00:52:39.752514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=396000000,duration_sec=226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:39.753100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:39.753584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:41.751724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:110 started Oct 16 00:52:41.754575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=398000000,duration_sec=228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:41.755167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:41.755528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:43.753627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:111 started Oct 16 00:52:43.756025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bf0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=399000000,duration_sec=230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:43.756585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:43.756941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:45.754838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:112 started Oct 16 00:52:45.757309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bf2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=400000000,duration_sec=232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:45.757905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:45.758260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:47.755762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:113 started Oct 16 00:52:47.759433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bf4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=402000000,duration_sec=234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:47.760118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:47.760574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:52:49.757258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:114 started Oct 16 00:52:49.760106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bf6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=403000000,duration_sec=236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:49.760674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:49.761036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:51.758818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:115 started Oct 16 00:52:51.761182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bf8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=404000000,duration_sec=238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:51.761744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:51.762124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:53.759596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:116 started Oct 16 00:52:53.762307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=405000000,duration_sec=240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:53.762903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:53.763267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:55.760543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:117 started Oct 16 00:52:55.762905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bfc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=406000000,duration_sec=242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:55.763475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:55.763833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:57.761312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:118 started Oct 16 00:52:57.764095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416bfe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=407000000,duration_sec=244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:57.765019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:57.765447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:52:59.762268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:119 started Oct 16 00:52:59.764631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=408000000,duration_sec=246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:52:59.765211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:52:59.765576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:01.763555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:120 started Oct 16 00:53:01.766024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=409000000,duration_sec=248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:01.766597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:01.766993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:03.764813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:121 started Oct 16 00:53:03.767937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=410000000,duration_sec=250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:03.768660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:03.769043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:53:05.766115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:122 started Oct 16 00:53:05.773068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=412000000,duration_sec=252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:05.780055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:05.780531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 00:53:07.766926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:123 started Oct 16 00:53:07.770008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=413000000,duration_sec=254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:07.770580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:07.770948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:09.768026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:124 started Oct 16 00:53:09.770576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=413000000,duration_sec=256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:09.771271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:09.771630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:11.768567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:125 started Oct 16 00:53:11.771445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=414000000,duration_sec=258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:11.772022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:11.772413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:13.770025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:126 started Oct 16 00:53:13.773116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=416000000,duration_sec=260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:13.773728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:13.774088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:15.771564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:127 started Oct 16 00:53:15.774760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=417000000,duration_sec=262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:15.775383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:15.775749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:17.772811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:128 started Oct 16 00:53:17.775754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=418000000,duration_sec=264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:17.776325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:17.776682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:19.774713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:129 started Oct 16 00:53:19.777558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=420000000,duration_sec=266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:19.778120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:19.778477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:21.776336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:130 started Oct 16 00:53:21.779870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=422000000,duration_sec=268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:21.780538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:21.781127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:53:23.777482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:131 started Oct 16 00:53:23.779847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=423000000,duration_sec=270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:23.780835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:23.781208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:25.778615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:132 started Oct 16 00:53:25.781763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=424000000,duration_sec=272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:25.782364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:25.783576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:53:27.779739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:133 started Oct 16 00:53:27.782840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=425000000,duration_sec=274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:27.783685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:27.784073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:53:29.781095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:134 started Oct 16 00:53:29.784235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c1e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=427000000,duration_sec=276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:29.784797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:29.785155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:31.784939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:135 started Oct 16 00:53:31.788079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=430000000,duration_sec=278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:31.788749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:31.789166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:53:33.783673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:136 started Oct 16 00:53:33.786277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c22,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=429000000,duration_sec=280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:33.786974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:33.787343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:35.784329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:137 started Oct 16 00:53:35.788291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=431000000,duration_sec=282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:35.789147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:35.789911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:53:37.785353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:138 started Oct 16 00:53:37.788325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c26,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=431000000,duration_sec=284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:37.788918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:37.789282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:39.786172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:139 started Oct 16 00:53:39.788722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=432000000,duration_sec=286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:39.789291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:39.789651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:41.787277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:140 started Oct 16 00:53:41.789931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=433000000,duration_sec=288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:41.790695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:41.791166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:43.532634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:53:43Z,description='Default security group',id=3752b618-e38b-468d-8f99-f586bcef44cb,is_default=True,name='default',project_id='d58f0bf90fb74d0fb8fce1e76d532c13',revision_number=1,rules=[SecurityGroupRule(59534a7b-aca3-4b04-a1b6-cd3cc7f66158),SecurityGroupRule(74d18ea0-8d86-475e-9ff1-de92270774d4),SecurityGroupRule(d1bb239c-1ab6-4c23-a0c0-18331e2ad976),SecurityGroupRule(f0a1a2ef-1d32-43ba-81d9-83ae7c40d516)],shared=False,stateful=True,updated_at=2022-10-16T00:53:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:53:43.533320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3752b618-e38b-468d-8f99-f586bcef44cb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.533801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:53:43Z,description=,direction='ingress',ethertype='IPv6',id=59534a7b-aca3-4b04-a1b6-cd3cc7f66158,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d58f0bf90fb74d0fb8fce1e76d532c13',protocol=,remote_address_group_id=,remote_group_id=3752b618-e38b-468d-8f99-f586bcef44cb,remote_ip_prefix=,revision_number=0,security_group_id=3752b618-e38b-468d-8f99-f586bcef44cb,updated_at=2022-10-16T00:53:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:53:43.534254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (59534a7b-aca3-4b04-a1b6-cd3cc7f66158), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.534672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.535486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:53:43Z,description=,direction='egress',ethertype='IPv6',id=74d18ea0-8d86-475e-9ff1-de92270774d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d58f0bf90fb74d0fb8fce1e76d532c13',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3752b618-e38b-468d-8f99-f586bcef44cb,updated_at=2022-10-16T00:53:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:53:43.535917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (74d18ea0-8d86-475e-9ff1-de92270774d4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.536320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.537058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:53:43Z,description=,direction='ingress',ethertype='IPv4',id=d1bb239c-1ab6-4c23-a0c0-18331e2ad976,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d58f0bf90fb74d0fb8fce1e76d532c13',protocol=,remote_address_group_id=,remote_group_id=3752b618-e38b-468d-8f99-f586bcef44cb,remote_ip_prefix=,revision_number=0,security_group_id=3752b618-e38b-468d-8f99-f586bcef44cb,updated_at=2022-10-16T00:53:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:53:43.537427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d1bb239c-1ab6-4c23-a0c0-18331e2ad976), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.537761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.538691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:53:43Z,description=,direction='egress',ethertype='IPv4',id=f0a1a2ef-1d32-43ba-81d9-83ae7c40d516,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d58f0bf90fb74d0fb8fce1e76d532c13',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3752b618-e38b-468d-8f99-f586bcef44cb,updated_at=2022-10-16T00:53:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:53:43.539085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f0a1a2ef-1d32-43ba-81d9-83ae7c40d516), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.539422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-980ba6ca-8637-4217-947e-1f7c5de6f5ad admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.755292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Resource SecurityGroup deleted: 3752b618-e38b-468d-8f99-f586bcef44cb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:53:43.755669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3752b618-e38b-468d-8f99-f586bcef44cb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.756365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3752b618-e38b-468d-8f99-f586bcef44cb',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:53:43.779278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3752b618-e38b-468d-8f99-f586bcef44cb',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:53:43.779738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Resource SecurityGroupRule deleted: 59534a7b-aca3-4b04-a1b6-cd3cc7f66158 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:53:43.780154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (59534a7b-aca3-4b04-a1b6-cd3cc7f66158), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.780503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.780903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Resource SecurityGroupRule deleted: 74d18ea0-8d86-475e-9ff1-de92270774d4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:53:43.781267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (74d18ea0-8d86-475e-9ff1-de92270774d4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.782301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.782301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Resource SecurityGroupRule deleted: d1bb239c-1ab6-4c23-a0c0-18331e2ad976 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:53:43.782511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d1bb239c-1ab6-4c23-a0c0-18331e2ad976), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.782833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.783452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Resource SecurityGroupRule deleted: f0a1a2ef-1d32-43ba-81d9-83ae7c40d516 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:53:43.783813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f0a1a2ef-1d32-43ba-81d9-83ae7c40d516), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:53:43.784144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ccd6af5-2dfe-4e41-9135-1eafa3f2e51f admin admin] Security group rule updated ['3752b618-e38b-468d-8f99-f586bcef44cb'] Oct 16 00:53:43.787572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:141 started Oct 16 00:53:43.789940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=433000000,duration_sec=290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:43.790531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:43.790934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:53:45.789014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:142 started Oct 16 00:53:45.792868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=435000000,duration_sec=292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:45.793964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:45.794411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:53:47.790034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:143 started Oct 16 00:53:47.792322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=435000000,duration_sec=294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:47.792906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:47.793267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:53:49.790684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:144 started Oct 16 00:53:49.793112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=436000000,duration_sec=296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:49.793707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:49.794078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:51.791742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:145 started Oct 16 00:53:51.794406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=437000000,duration_sec=298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:51.795002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:51.795469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:53.792715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:146 started Oct 16 00:53:53.795464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=438000000,duration_sec=300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:53.796028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:53.796385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:55.793553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:147 started Oct 16 00:53:55.796009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=439000000,duration_sec=302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:55.796558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:55.797451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:57.795204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:148 started Oct 16 00:53:57.797965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=441000000,duration_sec=304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:57.798528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:57.798917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:53:59.795827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:149 started Oct 16 00:53:59.798755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=441000000,duration_sec=306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:53:59.799340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:53:59.799707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:01.796316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:150 started Oct 16 00:54:01.799146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=442000000,duration_sec=308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:01.799739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:01.800093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:03.797997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:151 started Oct 16 00:54:03.800457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=443000000,duration_sec=310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:03.801052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:03.801405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:05.799406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:152 started Oct 16 00:54:05.801877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=445000000,duration_sec=312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:05.802448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:05.802803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:07.800154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:153 started Oct 16 00:54:07.802563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=446000000,duration_sec=314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:07.803173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:07.803530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:09.800613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:154 started Oct 16 00:54:09.803323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=446000000,duration_sec=316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:09.804179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:09.804542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:11.801872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:155 started Oct 16 00:54:11.804277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=447000000,duration_sec=318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:11.804845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:11.805200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:54:13.803341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:156 started Oct 16 00:54:13.805727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=449000000,duration_sec=320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:13.806294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:13.806648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:15.804137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:157 started Oct 16 00:54:15.806542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=450000000,duration_sec=322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:15.807159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:15.807516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:17.805368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:158 started Oct 16 00:54:17.807648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=451000000,duration_sec=324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:17.808263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:17.808614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:54:19.806284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:159 started Oct 16 00:54:19.808721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=452000000,duration_sec=326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:19.809285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:19.809638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:21.807617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:160 started Oct 16 00:54:21.810028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=453000000,duration_sec=328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:21.810604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:21.810992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:23.808261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:161 started Oct 16 00:54:23.811378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=454000000,duration_sec=330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:23.811958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:23.812314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:25.809429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:162 started Oct 16 00:54:25.811944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=455000000,duration_sec=332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:25.812514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:25.812875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:27.810657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:163 started Oct 16 00:54:27.813073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=456000000,duration_sec=334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:27.813644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:27.813997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:29.811490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:164 started Oct 16 00:54:29.814043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=457000000,duration_sec=336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:29.814624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:29.815220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:31.812179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:165 started Oct 16 00:54:31.816734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=459000000,duration_sec=338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:31.817590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:31.818160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:54:33.813730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:166 started Oct 16 00:54:33.816900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=459000000,duration_sec=340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:33.817473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:33.817824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:35.815171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:167 started Oct 16 00:54:35.817694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=461000000,duration_sec=342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:35.818258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:35.818610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:37.815828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:168 started Oct 16 00:54:37.818733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=461000000,duration_sec=344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:37.819315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:37.819667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:39.816709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:169 started Oct 16 00:54:39.819194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=462000000,duration_sec=346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:39.819767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:39.820124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:41.818452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:170 started Oct 16 00:54:41.820861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=464000000,duration_sec=348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:41.821419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:41.821771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:43.819535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:171 started Oct 16 00:54:43.821934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=465000000,duration_sec=350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:43.822505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:43.822878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:45.821082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:172 started Oct 16 00:54:45.824190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=467000000,duration_sec=352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:45.824770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:45.825156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:47.821588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:173 started Oct 16 00:54:47.823902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=467000000,duration_sec=354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:47.824472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:47.824828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:54:49.822919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:174 started Oct 16 00:54:49.825367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=468000000,duration_sec=356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:49.825936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:49.826298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:51.824042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:175 started Oct 16 00:54:51.826419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=469000000,duration_sec=358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:51.827014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:51.827645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:53.825195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:176 started Oct 16 00:54:53.827948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=471000000,duration_sec=360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:53.828536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:53.828887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:55.826828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:177 started Oct 16 00:54:55.829464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=473000000,duration_sec=362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:55.830031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:55.830385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:57.826922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:178 started Oct 16 00:54:57.829483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=473000000,duration_sec=364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:57.830050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:57.830404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:54:59.827841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:179 started Oct 16 00:54:59.830245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=473000000,duration_sec=366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:54:59.830814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:54:59.831202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:01.828884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:180 started Oct 16 00:55:01.831349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=474000000,duration_sec=368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:01.831925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:01.832885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:03.830783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:181 started Oct 16 00:55:03.833324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c7c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=476000000,duration_sec=370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:03.833895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:03.834254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:05.831584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:182 started Oct 16 00:55:05.834547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=478000000,duration_sec=372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:05.835146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:05.835507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:07.833092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:183 started Oct 16 00:55:07.835754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=478000000,duration_sec=374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:07.836335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:07.836696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:09.833888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:184 started Oct 16 00:55:09.836294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=479000000,duration_sec=376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:09.836854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:09.837209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:11.834656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:185 started Oct 16 00:55:11.837162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=480000000,duration_sec=378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:11.837793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:11.838220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:13.835170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:186 started Oct 16 00:55:13.837570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=481000000,duration_sec=380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:13.838128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:13.838475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:15.836391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:187 started Oct 16 00:55:15.839183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=482000000,duration_sec=382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:15.839760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:15.840120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:17.837664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:188 started Oct 16 00:55:17.841081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=484000000,duration_sec=384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:17.841721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:17.842110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:55:19.838329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:189 started Oct 16 00:55:19.842265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=485000000,duration_sec=386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:19.842946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:19.843382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:55:21.838855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:190 started Oct 16 00:55:21.841294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=484000000,duration_sec=388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:21.841867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:21.842225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:23.840168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:191 started Oct 16 00:55:23.842770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=486000000,duration_sec=390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:23.843375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:23.843738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:25.841004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:192 started Oct 16 00:55:25.843878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=486000000,duration_sec=392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:25.844462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:25.844824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:27.842456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:193 started Oct 16 00:55:27.844931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=488000000,duration_sec=394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:27.845508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:27.845869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:29.843615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:194 started Oct 16 00:55:29.845987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=489000000,duration_sec=396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:29.846556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:29.846942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:31.844358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:195 started Oct 16 00:55:31.847437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=490000000,duration_sec=398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:31.848002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:31.848359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:33.844972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:196 started Oct 16 00:55:33.848269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=490000000,duration_sec=400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:33.848844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:33.849207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:35.846048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:197 started Oct 16 00:55:35.848655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=492000000,duration_sec=402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:35.849218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:35.849605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:37.847327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:198 started Oct 16 00:55:37.849715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416c9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=493000000,duration_sec=404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:37.850292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:37.850751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:39.848383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:199 started Oct 16 00:55:39.851418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ca0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=494000000,duration_sec=406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:39.852074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:39.852437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:41.849236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:200 started Oct 16 00:55:41.851651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ca2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=495000000,duration_sec=408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:41.852227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:41.852618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:43.850558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:201 started Oct 16 00:55:43.852885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ca4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=496000000,duration_sec=410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:43.853463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:43.853812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:45.851624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:202 started Oct 16 00:55:45.853993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ca6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=497000000,duration_sec=412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:45.854562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:45.854948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:47.852146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:203 started Oct 16 00:55:47.854566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ca8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=498000000,duration_sec=414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:47.855172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:47.855531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:49.852653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:204 started Oct 16 00:55:49.855071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416caa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=498000000,duration_sec=416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:49.855643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:49.855998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:55:51.853803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:205 started Oct 16 00:55:51.856180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=499000000,duration_sec=418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:51.856739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:51.857087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:53.855225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:206 started Oct 16 00:55:53.857595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=501000000,duration_sec=420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:53.858159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:53.858511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:55.855835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:207 started Oct 16 00:55:55.858165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=501000000,duration_sec=422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:55.858730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:55.859106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:57.856815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:208 started Oct 16 00:55:57.859217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=502000000,duration_sec=424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:57.859804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:57.860168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:55:59.857848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:209 started Oct 16 00:55:59.860496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=503000000,duration_sec=426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:55:59.861130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:55:59.861842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:01.859255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:210 started Oct 16 00:56:01.862291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=505000000,duration_sec=428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:01.862924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:01.863285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:03.860300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:211 started Oct 16 00:56:03.865366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=508000000,duration_sec=430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:03.865950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:03.866308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:56:05.861602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:212 started Oct 16 00:56:05.864951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=508000000,duration_sec=432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:05.865570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:05.865925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:56:07.862244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:213 started Oct 16 00:56:07.865161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=508000000,duration_sec=434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:07.866093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:07.866450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:09.863052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:214 started Oct 16 00:56:09.870686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=509000000,duration_sec=436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:09.872408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:09.872787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 00:56:11.863579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:215 started Oct 16 00:56:11.866020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=509000000,duration_sec=438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:11.866596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:11.866990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:13.864750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:216 started Oct 16 00:56:13.867343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cc2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=510000000,duration_sec=440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:13.867916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:13.868265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:15.865816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:217 started Oct 16 00:56:15.868302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=511000000,duration_sec=442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:15.868939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:15.869295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:17.867121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:218 started Oct 16 00:56:17.869661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=513000000,duration_sec=444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:17.870264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:17.870631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:19.868433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:219 started Oct 16 00:56:19.871215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cc8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=514000000,duration_sec=446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:19.871782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:19.872133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:21.869824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:220 started Oct 16 00:56:21.872433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=515000000,duration_sec=448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:21.873011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:21.873373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:23.871115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:221 started Oct 16 00:56:23.873496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ccc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=517000000,duration_sec=450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:23.874080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:23.874526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:25.871753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:222 started Oct 16 00:56:25.874117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=517000000,duration_sec=452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:25.874718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:25.875101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 00:56:27.873257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:223 started Oct 16 00:56:27.879208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=519000000,duration_sec=454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:27.880322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:27.881096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:56:29.874368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:224 started Oct 16 00:56:29.880459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cd2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=521000000,duration_sec=456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:29.881643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:29.883288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 00:56:31.876730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:225 started Oct 16 00:56:31.880703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=523000000,duration_sec=458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:31.881313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:31.881679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:56:33.877391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:226 started Oct 16 00:56:33.880220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=523000000,duration_sec=460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:33.880795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:33.881159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:35.878172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:227 started Oct 16 00:56:35.880655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=524000000,duration_sec=462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:35.881277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:35.881615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:37.879091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:228 started Oct 16 00:56:37.881857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=525000000,duration_sec=464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:37.882536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:37.882920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:39.879669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:229 started Oct 16 00:56:39.882430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=525000000,duration_sec=466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:39.883036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:39.883393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:41.880441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:230 started Oct 16 00:56:41.883626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=526000000,duration_sec=468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:41.884196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:41.884553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:43.886294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:231 started Oct 16 00:56:43.888804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ce0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=532000000,duration_sec=470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:43.889359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:43.889714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:56:45.887670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:232 started Oct 16 00:56:45.891586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ce2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=534000000,duration_sec=472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:45.892209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:45.892717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:56:47.889289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:233 started Oct 16 00:56:47.892639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ce4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=536000000,duration_sec=474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:47.893334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:47.893691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:56:49.890275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:234 started Oct 16 00:56:49.894393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ce6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=536000000,duration_sec=476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:49.895178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:49.895596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:56:51.891412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:235 started Oct 16 00:56:51.895252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ce8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=537000000,duration_sec=478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:51.897262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:51.898009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:56:53.892612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:236 started Oct 16 00:56:53.896486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=538000000,duration_sec=480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:53.897296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:53.897739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:56:55.893914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:237 started Oct 16 00:56:55.897265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=540000000,duration_sec=482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:55.898522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:55.899060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:56:57.895678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:238 started Oct 16 00:56:57.899513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=541000000,duration_sec=484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:57.901115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:57.901673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:56:59.897204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:239 started Oct 16 00:56:59.901259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cf0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=543000000,duration_sec=486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:56:59.903052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:56:59.903663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:57:01.897860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:240 started Oct 16 00:57:01.900746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cf2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=543000000,duration_sec=488,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:01.901456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:01.901893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:57:03.899206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:241 started Oct 16 00:57:03.901979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cf4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=545000000,duration_sec=490,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:03.902704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:03.903306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:57:05.900623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:242 started Oct 16 00:57:05.905754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cf6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=547000000,duration_sec=492,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:05.906674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:05.907253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:57:07.901865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:243 started Oct 16 00:57:07.908209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cf8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=549000000,duration_sec=494,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:07.909104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:07.909662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 00:57:09.903682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:244 started Oct 16 00:57:09.913862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=550000000,duration_sec=496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:09.914776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:09.915360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 16 00:57:11.873341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:11Z,description='Default security group',id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,is_default=True,name='default',project_id='c89fd0e945344feab91a37fdb93812e5',revision_number=1,rules=[SecurityGroupRule(603e2948-9da6-4414-9afd-725f33276d83),SecurityGroupRule(914fe685-0163-493b-9a19-7d727625cd3a),SecurityGroupRule(c725f166-6281-4828-a8d0-5b389b180409),SecurityGroupRule(fee1fb13-9077-49e3-b710-b84a139f8597)],shared=False,stateful=True,updated_at=2022-10-16T00:57:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:11.877099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3fac4e82-9a4f-452d-92ae-7c5d7772b1b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:11.877099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:11Z,description=,direction='ingress',ethertype='IPv4',id=603e2948-9da6-4414-9afd-725f33276d83,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c89fd0e945344feab91a37fdb93812e5',protocol=,remote_address_group_id=,remote_group_id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,remote_ip_prefix=,revision_number=0,security_group_id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,updated_at=2022-10-16T00:57:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:11.877099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (603e2948-9da6-4414-9afd-725f33276d83), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:11.877099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:57:11.878717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:11Z,description=,direction='egress',ethertype='IPv4',id=914fe685-0163-493b-9a19-7d727625cd3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c89fd0e945344feab91a37fdb93812e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,updated_at=2022-10-16T00:57:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:11.878717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (914fe685-0163-493b-9a19-7d727625cd3a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:11.878717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:57:11.879266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:11Z,description=,direction='ingress',ethertype='IPv6',id=c725f166-6281-4828-a8d0-5b389b180409,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c89fd0e945344feab91a37fdb93812e5',protocol=,remote_address_group_id=,remote_group_id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,remote_ip_prefix=,revision_number=0,security_group_id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,updated_at=2022-10-16T00:57:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:11.879266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c725f166-6281-4828-a8d0-5b389b180409), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:11.879266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:57:11.881196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:11Z,description=,direction='egress',ethertype='IPv6',id=fee1fb13-9077-49e3-b710-b84a139f8597,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c89fd0e945344feab91a37fdb93812e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3fac4e82-9a4f-452d-92ae-7c5d7772b1b0,updated_at=2022-10-16T00:57:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:11.881196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fee1fb13-9077-49e3-b710-b84a139f8597), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:11.881196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:57:11.905501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:245 started Oct 16 00:57:11.915676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cfc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=553000000,duration_sec=498,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:11.919722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:11.919722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 00:57:12.058932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:57:11Z,description='',dns_domain=None,id=987da718-4a64-4801-99fd-c8b997ad845b,mtu=1500,name='tempest-DeleteServersTestJSON-1769523312-network',project_id='c89fd0e945344feab91a37fdb93812e5',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(987da718-4a64-4801-99fd-c8b997ad845b),segments=[NetworkSegment(ebb1560a-1126-4b15-8db8-f323ab73a037)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:57:11Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:12.060105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (987da718-4a64-4801-99fd-c8b997ad845b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-d4156d76-0f74-4d57-ad42-731c1e3fbc9c admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 987da718-4a64-4801-99fd-c8b997ad845b with segmentation id not found. Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:57:12.209301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:57:12.211602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:57:12.211602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:57:12.211602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:57:12.211602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 987da718-4a64-4801-99fd-c8b997ad845b with segmentation id not found. Oct 16 00:57:12.211602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:57:12.488880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-115f8195-0c5f-475b-966c-962f63a1dedb admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(dd83f294-f6be-448b-809a-4e3e05059b1e)],cidr=172.20.0.0/28,created_at=2022-10-16T00:57:12Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=8fb2b922-74d5-4cae-b397-0d0c25d2079f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-1769523312-subnet',network_id=987da718-4a64-4801-99fd-c8b997ad845b,project_id='c89fd0e945344feab91a37fdb93812e5',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:57:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:12.489294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-115f8195-0c5f-475b-966c-962f63a1dedb admin admin] Publish callbacks [] for Subnet (8fb2b922-74d5-4cae-b397-0d0c25d2079f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:13.493550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edb032e-efd1-43ac-a8b2-7463cbc5f4cd None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:12Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-987da718-4a64-4801-99fd-c8b997ad845b',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=831df3a8-d68b-40e9-b52b-297c2989e047,mac_address=fa:16:3e:f9:89:d9,name='',network_id=987da718-4a64-4801-99fd-c8b997ad845b,numa_affinity_policy=,project_id='c89fd0e945344feab91a37fdb93812e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(831df3a8-d68b-40e9-b52b-297c2989e047),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:13.494211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edb032e-efd1-43ac-a8b2-7463cbc5f4cd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (831df3a8-d68b-40e9-b52b-297c2989e047), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:13.824429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edb032e-efd1-43ac-a8b2-7463cbc5f4cd None None] Resource Port 831df3a8-d68b-40e9-b52b-297c2989e047 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=831df3a8-d68b-40e9-b52b-297c2989e047,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=831df3a8-d68b-40e9-b52b-297c2989e047,segment=NetworkSegment(ebb1560a-1126-4b15-8db8-f323ab73a037),segment_id=ebb1560a-1126-4b15-8db8-f323ab73a037)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=831df3a8-d68b-40e9-b52b-297c2989e047,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:13.824753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edb032e-efd1-43ac-a8b2-7463cbc5f4cd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (831df3a8-d68b-40e9-b52b-297c2989e047), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:13.905562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:246 started Oct 16 00:57:13.927432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416cfe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=567000000,duration_sec=500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:13.929078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:13.930151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:246 - starting polling. Elapsed:0.025 Oct 16 00:57:13.940285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:13.951069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:246 - port information retrieved. Elapsed:0.045 Oct 16 00:57:13.955689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.048 Oct 16 00:57:13.982293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-21e9cb7f-2726-4ba3-abb0-ce408f6cc698 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:13Z,data_plane_status=None,description='',device_id='0fe95cc5-8422-458f-b86c-c45f224fe276',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=92fd08e3-e2b0-40c2-b892-f442ec78a775,mac_address=fa:16:3e:e5:01:66,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(92fd08e3-e2b0-40c2-b892-f442ec78a775),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:13.987160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-21e9cb7f-2726-4ba3-abb0-ce408f6cc698 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (92fd08e3-e2b0-40c2-b892-f442ec78a775), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:14.115270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["302a2eb0-198a-47b2-88a1-d62577b8ddd6","insert","tap831df3a8-d6",["set",[]],["map",[["attached-mac","fa:16:3e:f9:89:d9"],["iface-id","831df3a8-d68b-40e9-b52b-297c2989e047"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:14.241694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["302a2eb0-198a-47b2-88a1-d62577b8ddd6","old",null,["set",[]],null],["","new","tap831df3a8-d6",6,["map",[["attached-mac","fa:16:3e:f9:89:d9"],["iface-id","831df3a8-d68b-40e9-b52b-297c2989e047"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:15.279063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:13Z,description='Default security group',id=2373011f-2524-4861-b686-1d88cdba9ae8,is_default=True,name='default',project_id='5462fcbfca114c8885f77f42b479b13d',revision_number=1,rules=[SecurityGroupRule(0b217338-8e3e-431e-9f0f-8f2c341ef1a7),SecurityGroupRule(3edd512b-a2a2-47d2-b6ef-a8648f1103b4),SecurityGroupRule(4e79adc1-d6b3-4b40-b895-4f3f03ca1912),SecurityGroupRule(5eb229dd-e11a-4218-b94f-6b9455c552cd)],shared=False,stateful=True,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.281747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2373011f-2524-4861-b686-1d88cdba9ae8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.283454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:13Z,description=,direction='ingress',ethertype='IPv4',id=0b217338-8e3e-431e-9f0f-8f2c341ef1a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol=,remote_address_group_id=,remote_group_id=2373011f-2524-4861-b686-1d88cdba9ae8,remote_ip_prefix=,revision_number=0,security_group_id=2373011f-2524-4861-b686-1d88cdba9ae8,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.284555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0b217338-8e3e-431e-9f0f-8f2c341ef1a7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.286081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 00:57:15.289813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=3edd512b-a2a2-47d2-b6ef-a8648f1103b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2373011f-2524-4861-b686-1d88cdba9ae8,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.290947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3edd512b-a2a2-47d2-b6ef-a8648f1103b4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.290947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 00:57:15.293679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=4e79adc1-d6b3-4b40-b895-4f3f03ca1912,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol=,remote_address_group_id=,remote_group_id=2373011f-2524-4861-b686-1d88cdba9ae8,remote_ip_prefix=,revision_number=0,security_group_id=2373011f-2524-4861-b686-1d88cdba9ae8,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.294076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4e79adc1-d6b3-4b40-b895-4f3f03ca1912), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.294422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 00:57:15.295768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:13Z,description=,direction='egress',ethertype='IPv4',id=5eb229dd-e11a-4218-b94f-6b9455c552cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2373011f-2524-4861-b686-1d88cdba9ae8,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.297775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5eb229dd-e11a-4218-b94f-6b9455c552cd), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.298130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 00:57:15.763048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:57:14Z,description='',dns_domain=None,id=62c35b48-ed00-45fe-9f3a-baf6863ebf0f,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-659639345-network',project_id='0ebf28d90fe7429d94e65b524ce8d9de',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(62c35b48-ed00-45fe-9f3a-baf6863ebf0f),segments=[NetworkSegment(412a25ad-e65c-4846-9a89-c54024362309)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:57:14Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.763523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (62c35b48-ed00-45fe-9f3a-baf6863ebf0f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.778262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:13Z,description='Default security group',id=2114e761-d924-4615-a343-717baad55944,is_default=True,name='default',project_id='0ebf28d90fe7429d94e65b524ce8d9de',revision_number=1,rules=[SecurityGroupRule(6cf9e2ac-5779-4ba8-b711-d8f760dfdf07),SecurityGroupRule(96c0ee9c-06b6-4bfa-8b39-962e49e3f12d),SecurityGroupRule(c338de55-fe28-498b-985a-dc26c07d0c32),SecurityGroupRule(ec990a23-582c-4870-b4fb-15d4260ac398)],shared=False,stateful=True,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.783332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2114e761-d924-4615-a343-717baad55944), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.788054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:13Z,description=,direction='ingress',ethertype='IPv6',id=6cf9e2ac-5779-4ba8-b711-d8f760dfdf07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ebf28d90fe7429d94e65b524ce8d9de',protocol=,remote_address_group_id=,remote_group_id=2114e761-d924-4615-a343-717baad55944,remote_ip_prefix=,revision_number=0,security_group_id=2114e761-d924-4615-a343-717baad55944,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.790040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6cf9e2ac-5779-4ba8-b711-d8f760dfdf07), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.793338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:15.796567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=96c0ee9c-06b6-4bfa-8b39-962e49e3f12d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ebf28d90fe7429d94e65b524ce8d9de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2114e761-d924-4615-a343-717baad55944,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.800296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (96c0ee9c-06b6-4bfa-8b39-962e49e3f12d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.801208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:15.842793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:13Z,description=,direction='ingress',ethertype='IPv4',id=c338de55-fe28-498b-985a-dc26c07d0c32,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ebf28d90fe7429d94e65b524ce8d9de',protocol=,remote_address_group_id=,remote_group_id=2114e761-d924-4615-a343-717baad55944,remote_ip_prefix=,revision_number=0,security_group_id=2114e761-d924-4615-a343-717baad55944,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.846280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c338de55-fe28-498b-985a-dc26c07d0c32), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.846637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:15.851996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:13Z,description=,direction='egress',ethertype='IPv4',id=ec990a23-582c-4870-b4fb-15d4260ac398,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ebf28d90fe7429d94e65b524ce8d9de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2114e761-d924-4615-a343-717baad55944,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:15.852760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ec990a23-582c-4870-b4fb-15d4260ac398), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.854971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:15.909860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:247 started Oct 16 00:57:15.913475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=556000000,duration_sec=502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:15.915186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:15.915924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:247 - starting polling. Elapsed:0.006 Oct 16 00:57:15.918446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:15.920870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:247 - port information retrieved. Elapsed:0.011 Oct 16 00:57:15.921400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '831df3a8-d68b-40e9-b52b-297c2989e047'}, 'added': {'831df3a8-d68b-40e9-b52b-297c2989e047'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:15.922450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '831df3a8-d68b-40e9-b52b-297c2989e047', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-987da718-4a64-4801-99fd-c8b997ad845b', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': '831df3a8-d68b-40e9-b52b-297c2989e047', 'mac_address': 'fa:16:3e:f9:89:d9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:15.928196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 831df3a8-d68b-40e9-b52b-297c2989e047 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:15.930354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 831df3a8-d68b-40e9-b52b-297c2989e047 updated. Details: {'device': '831df3a8-d68b-40e9-b52b-297c2989e047', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-987da718-4a64-4801-99fd-c8b997ad845b', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': '831df3a8-d68b-40e9-b52b-297c2989e047', 'mac_address': 'fa:16:3e:f9:89:d9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:57:15.932711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 4 as local vlan for net-id=987da718-4a64-4801-99fd-c8b997ad845b, seg-id=363 Oct 16 00:57:15.945307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c83,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4459), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-f3b2c446-7b44-45b2-a43f-92aee247ea5f admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 62c35b48-ed00-45fe-9f3a-baf6863ebf0f with segmentation id not found. Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:57:15.961744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:57:15.962719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:57:15.962719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:57:15.962719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:57:15.962719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 62c35b48-ed00-45fe-9f3a-baf6863ebf0f with segmentation id not found. Oct 16 00:57:15.962719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:57:15.968903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416d02,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4459}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:15.973833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap831df3a8-d6, col_values=(('tag', 4),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:15.976753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap831df3a8-d6, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:15.977863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap831df3a8-d6, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:16.008203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap831df3a8-d6, col_values=(('other_config', {'net_uuid': '987da718-4a64-4801-99fd-c8b997ad845b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '363'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:16.044568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d04,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:16.046287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:247 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.124 Oct 16 00:57:16.049845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:57:16.050472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'831df3a8-d68b-40e9-b52b-297c2989e047'} Oct 16 00:57:16.052031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:16.054590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:16.068536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:16.180201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c9c7d-6e62-49bf-937c-a14cface5cbb]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:16.181061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:247 - agent port security group processed in 0.259 Oct 16 00:57:16.181785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 831df3a8-d68b-40e9-b52b-297c2989e047 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:16.713837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ed6f7f64-9528-4f0e-9dd4-ce0f6277d8f0 None None] Resource Port 831df3a8-d68b-40e9-b52b-297c2989e047 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:16.714534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ed6f7f64-9528-4f0e-9dd4-ce0f6277d8f0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (831df3a8-d68b-40e9-b52b-297c2989e047), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:16.883902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f815ac2f-ade4-4b39-b8a7-b226c58c7968 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e423b445-70de-4349-bb8b-69258053205b)],cidr=172.20.0.0/28,created_at=2022-10-16T00:57:16Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=2cc1effe-1348-4c66-90fa-b8e4bc5b9dca,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-659639345-subnet',network_id=62c35b48-ed00-45fe-9f3a-baf6863ebf0f,project_id='0ebf28d90fe7429d94e65b524ce8d9de',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:57:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:16.884412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f815ac2f-ade4-4b39-b8a7-b226c58c7968 admin admin] Publish callbacks [] for Subnet (2cc1effe-1348-4c66-90fa-b8e4bc5b9dca), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:16.994759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:14Z,description='Default security group',id=bfc3cec1-1713-4e74-91f5-897a956f6102,is_default=True,name='default',project_id='fb3c758e27684dcd9265e2d60036d80b',revision_number=1,rules=[SecurityGroupRule(1c20afe0-ea9a-40ba-88e3-d6379d8a25d5),SecurityGroupRule(2babb8ce-7da9-40ec-92e1-aa15b3a60621),SecurityGroupRule(eba8635f-f373-4496-a102-777f1231fd6d),SecurityGroupRule(f43f9ba4-a380-4133-9181-caa3a148e1eb)],shared=False,stateful=True,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:16.995260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (bfc3cec1-1713-4e74-91f5-897a956f6102), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:16.996231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=1c20afe0-ea9a-40ba-88e3-d6379d8a25d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=bfc3cec1-1713-4e74-91f5-897a956f6102,remote_ip_prefix=,revision_number=0,security_group_id=bfc3cec1-1713-4e74-91f5-897a956f6102,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:16.996673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1c20afe0-ea9a-40ba-88e3-d6379d8a25d5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:16.997072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 00:57:16.997851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=2babb8ce-7da9-40ec-92e1-aa15b3a60621,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfc3cec1-1713-4e74-91f5-897a956f6102,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:16.998841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2babb8ce-7da9-40ec-92e1-aa15b3a60621), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.007213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 00:57:17.010033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='ingress',ethertype='IPv4',id=eba8635f-f373-4496-a102-777f1231fd6d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=bfc3cec1-1713-4e74-91f5-897a956f6102,remote_ip_prefix=,revision_number=0,security_group_id=bfc3cec1-1713-4e74-91f5-897a956f6102,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.012984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (eba8635f-f373-4496-a102-777f1231fd6d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.013631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 00:57:17.015612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='egress',ethertype='IPv4',id=f43f9ba4-a380-4133-9181-caa3a148e1eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfc3cec1-1713-4e74-91f5-897a956f6102,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.018627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f43f9ba4-a380-4133-9181-caa3a148e1eb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.022497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 00:57:17.036467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['831df3a8-d68b-40e9-b52b-297c2989e047'] and devices down [] completed. Oct 16 00:57:17.037353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:247 - ports processed. Elapsed:1.128 Oct 16 00:57:17.037908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:1.128 Oct 16 00:57:17.066033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:13Z,description='Default security group',id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,is_default=True,name='default',project_id='cca355ef4a294ecd88cc299b7e0ca9d8',revision_number=1,rules=[SecurityGroupRule(1cd8e9e9-9b21-4331-ac4e-a02b8b404fc0),SecurityGroupRule(7cb8d207-9e9e-4d1d-8642-6f325a70db66),SecurityGroupRule(905b8bb3-ca57-4461-a65e-dbfcdab46837),SecurityGroupRule(aa74bd42-e66f-4249-9683-b22505e1b653)],shared=False,stateful=True,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.067020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (9236e40c-bc5b-4898-8dde-3af8e3c85f1b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.068951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='egress',ethertype='IPv4',id=1cd8e9e9-9b21-4331-ac4e-a02b8b404fc0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.069604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1cd8e9e9-9b21-4331-ac4e-a02b8b404fc0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.071112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 00:57:17.074196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='ingress',ethertype='IPv6',id=7cb8d207-9e9e-4d1d-8642-6f325a70db66,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,remote_ip_prefix=,revision_number=0,security_group_id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.075289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7cb8d207-9e9e-4d1d-8642-6f325a70db66), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.076758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 00:57:17.079159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:14Z,description=,direction='egress',ethertype='IPv6',id=905b8bb3-ca57-4461-a65e-dbfcdab46837,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,updated_at=2022-10-16T00:57:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.081105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (905b8bb3-ca57-4461-a65e-dbfcdab46837), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.082588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 00:57:17.084630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:13Z,description=,direction='ingress',ethertype='IPv4',id=aa74bd42-e66f-4249-9683-b22505e1b653,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,remote_ip_prefix=,revision_number=0,security_group_id=9236e40c-bc5b-4898-8dde-3af8e3c85f1b,updated_at=2022-10-16T00:57:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.086175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (aa74bd42-e66f-4249-9683-b22505e1b653), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.088482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 00:57:17.103653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:57:14Z,description='',dns_domain=None,id=f6d9aa56-b330-4b62-a416-c067206c96f0,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-363074438-network',project_id='5462fcbfca114c8885f77f42b479b13d',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(f6d9aa56-b330-4b62-a416-c067206c96f0),segments=[NetworkSegment(6387b2f2-0bee-4573-8938-2efc29213a5f)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:57:14Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.106793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (f6d9aa56-b330-4b62-a416-c067206c96f0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.119378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5f6951f3-329a-45bb-872a-3b7ee4dae162 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(80559e74-adf7-4770-907a-1fd86e67195c)],cidr=172.20.0.0/28,created_at=2022-10-16T00:57:16Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-363074438-subnet',network_id=f6d9aa56-b330-4b62-a416-c067206c96f0,project_id='5462fcbfca114c8885f77f42b479b13d',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:57:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.120758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5f6951f3-329a-45bb-872a-3b7ee4dae162 admin admin] Publish callbacks [] for Subnet (a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.163990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b1800f-ba8f-4fc6-bc8e-84b20c43cf18 None None] Resource Port 92fd08e3-e2b0-40c2-b892-f442ec78a775 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:17.165594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b1800f-ba8f-4fc6-bc8e-84b20c43cf18 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (92fd08e3-e2b0-40c2-b892-f442ec78a775), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-e2f18adb-9a22-4ee3-88b9-a6b6c8a69317 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f6d9aa56-b330-4b62-a416-c067206c96f0 with segmentation id not found. Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:57:17.384150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:57:17.385270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:57:17.385270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:57:17.385270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:57:17.385270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f6d9aa56-b330-4b62-a416-c067206c96f0 with segmentation id not found. Oct 16 00:57:17.385270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:57:17.617354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:57:14Z,description='',dns_domain=None,id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,mtu=1500,name='tempest-AttachVolumeNegativeTest-1032949237-network',project_id='fb3c758e27684dcd9265e2d60036d80b',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(7dae3d76-90a2-41d2-9dad-7f7856d5ab85),segments=[NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:57:15Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:17.617939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (7dae3d76-90a2-41d2-9dad-7f7856d5ab85), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.662350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b1800f-ba8f-4fc6-bc8e-84b20c43cf18 None None] Resource Port 92fd08e3-e2b0-40c2-b892-f442ec78a775 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:17.664753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b1800f-ba8f-4fc6-bc8e-84b20c43cf18 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (92fd08e3-e2b0-40c2-b892-f442ec78a775), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.911783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:248 started Oct 16 00:57:17.919709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=560000000,duration_sec=504,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:17.921507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:17.922340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:248 - starting polling. Elapsed:0.011 Oct 16 00:57:17.926316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:17.938800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:248 - port information retrieved. Elapsed:0.027 Oct 16 00:57:17.940806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '831df3a8-d68b-40e9-b52b-297c2989e047'}, 'added': set(), 'removed': set(), 'updated': {'831df3a8-d68b-40e9-b52b-297c2989e047'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:17.943648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '831df3a8-d68b-40e9-b52b-297c2989e047', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-987da718-4a64-4801-99fd-c8b997ad845b', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': '831df3a8-d68b-40e9-b52b-297c2989e047', 'mac_address': 'fa:16:3e:f9:89:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:17.958090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 831df3a8-d68b-40e9-b52b-297c2989e047 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:17.961125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 831df3a8-d68b-40e9-b52b-297c2989e047 updated. Details: {'device': '831df3a8-d68b-40e9-b52b-297c2989e047', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-987da718-4a64-4801-99fd-c8b997ad845b', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': '831df3a8-d68b-40e9-b52b-297c2989e047', 'mac_address': 'fa:16:3e:f9:89:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 16 00:57:17.970131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap831df3a8-d6, col_values=(('tag', 4),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:17.974910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap831df3a8-d6, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:17.976239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap831df3a8-d6, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:17.982263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:17.992681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap831df3a8-d6, col_values=(('other_config', {'net_uuid': '987da718-4a64-4801-99fd-c8b997ad845b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '363', 'tag': '4'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:17.997789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-a6caaa8e-f1e8-42fa-84a3-26bc82357850 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 7dae3d76-90a2-41d2-9dad-7f7856d5ab85 with segmentation id not found. Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:57:18.010836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:57:18.012441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:57:18.012441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:57:18.012441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:57:18.012441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 7dae3d76-90a2-41d2-9dad-7f7856d5ab85 with segmentation id not found. Oct 16 00:57:18.012441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:57:18.022981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d08,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:18.026490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:248 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.083 Oct 16 00:57:18.031991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:57:18.035268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:57:18.041191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:18.045811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:18.054118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:18.157081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:57:14Z,description='',dns_domain=None,id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-665385219-network',project_id='cca355ef4a294ecd88cc299b7e0ca9d8',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(758abdbd-543f-42fe-8aa7-53af6cbbeb5d),segments=[NetworkSegment(dcee8df3-2008-4b96-bcaf-2c5a70d931e0)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:57:14Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:18.158068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (758abdbd-543f-42fe-8aa7-53af6cbbeb5d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:18.187447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f6337-120b-4697-91cc-431ba4b1b9c1]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:18.189807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:248 - agent port security group processed in 0.247 Oct 16 00:57:18.191276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 831df3a8-d68b-40e9-b52b-297c2989e047 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:18.210404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-87bfa95d-ec96-4f0c-aaa9-a560704d8438 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(27dce5db-dab3-462f-992b-f1e267207aeb)],cidr=172.20.0.0/28,created_at=2022-10-16T00:57:17Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=a617817b-7e5e-42c9-b510-1f81c28bf50c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-1032949237-subnet',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,project_id='fb3c758e27684dcd9265e2d60036d80b',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:57:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:18.211560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-87bfa95d-ec96-4f0c-aaa9-a560704d8438 admin admin] Publish callbacks [] for Subnet (a617817b-7e5e-42c9-b510-1f81c28bf50c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-c474fcae-dddd-478b-8639-84f24a3a0228 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 758abdbd-543f-42fe-8aa7-53af6cbbeb5d with segmentation id not found. Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:57:18.839572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:57:18.840654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:57:18.840654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:57:18.840654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:57:18.840654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 758abdbd-543f-42fe-8aa7-53af6cbbeb5d with segmentation id not found. Oct 16 00:57:18.840654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:57:19.147921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["84e06250-05b2-4687-a5e2-da0328837d7b","insert","qg-92fd08e3-e2",["set",[]],["map",[["attached-mac","fa:16:3e:e5:01:66"],["iface-id","92fd08e3-e2b0-40c2-b892-f442ec78a775"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:19.177135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["84e06250-05b2-4687-a5e2-da0328837d7b","old",null,["set",[]],null],["","new","qg-92fd08e3-e2",7,["map",[["attached-mac","fa:16:3e:e5:01:66"],["iface-id","92fd08e3-e2b0-40c2-b892-f442ec78a775"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:19.347326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a379281-1f59-4712-b879-a02da2a42ea6 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(002bb8b0-03b2-4a48-97db-2bcf286259b3)],cidr=172.20.0.0/28,created_at=2022-10-16T00:57:17Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-665385219-subnet',network_id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:57:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:19.366931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a379281-1f59-4712-b879-a02da2a42ea6 admin admin] Publish callbacks [] for Subnet (ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:19.819934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:18Z,description='Default security group',id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,is_default=True,name='default',project_id='0d378a01be2044faa872ca43f816dbd9',revision_number=1,rules=[SecurityGroupRule(1a112ff5-6013-4b05-a18d-c74fabbae91e),SecurityGroupRule(60fcbd91-1add-4c39-8771-f9b402e6a4b0),SecurityGroupRule(cdc51d1b-9da5-446f-bb7a-18035bff1386),SecurityGroupRule(f8e34c06-f9ce-48ad-8065-c61d4c75f61a)],shared=False,stateful=True,updated_at=2022-10-16T00:57:18Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:19.820952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (4fa51d52-91bc-479e-87c3-7ed0c2c8eb43), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:19.822407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:19Z,description=,direction='egress',ethertype='IPv6',id=1a112ff5-6013-4b05-a18d-c74fabbae91e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d378a01be2044faa872ca43f816dbd9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,updated_at=2022-10-16T00:57:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:19.823381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1a112ff5-6013-4b05-a18d-c74fabbae91e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:19.827683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:19.831373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:18Z,description=,direction='ingress',ethertype='IPv4',id=60fcbd91-1add-4c39-8771-f9b402e6a4b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d378a01be2044faa872ca43f816dbd9',protocol=,remote_address_group_id=,remote_group_id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,remote_ip_prefix=,revision_number=0,security_group_id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,updated_at=2022-10-16T00:57:18Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:19.834099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (60fcbd91-1add-4c39-8771-f9b402e6a4b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:19.838103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:19.843130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:19Z,description=,direction='ingress',ethertype='IPv6',id=cdc51d1b-9da5-446f-bb7a-18035bff1386,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d378a01be2044faa872ca43f816dbd9',protocol=,remote_address_group_id=,remote_group_id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,remote_ip_prefix=,revision_number=0,security_group_id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,updated_at=2022-10-16T00:57:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:19.848301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (cdc51d1b-9da5-446f-bb7a-18035bff1386), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:19.850391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:19.853215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:18Z,description=,direction='egress',ethertype='IPv4',id=f8e34c06-f9ce-48ad-8065-c61d4c75f61a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d378a01be2044faa872ca43f816dbd9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4fa51d52-91bc-479e-87c3-7ed0c2c8eb43,updated_at=2022-10-16T00:57:18Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:19.856085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f8e34c06-f9ce-48ad-8065-c61d4c75f61a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:19.856948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d81b53c-040c-4c63-927e-061526020a0d admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:19.973639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['831df3a8-d68b-40e9-b52b-297c2989e047'] and devices down [] completed. Oct 16 00:57:19.974692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:248 - ports processed. Elapsed:2.063 Oct 16 00:57:19.975790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:2.064 Oct 16 00:57:19.977837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Loop iteration exceeded interval (2 vs. 2.0641987323760986)! {{(pid=105601) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 16 00:57:19.979209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:249 started Oct 16 00:57:19.990600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=630000000,duration_sec=506,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:19.993262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:19.994115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:249 - starting polling. Elapsed:0.016 Oct 16 00:57:19.996318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:20.001321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:249 - port information retrieved. Elapsed:0.023 Oct 16 00:57:20.001907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '831df3a8-d68b-40e9-b52b-297c2989e047'}, 'added': {'92fd08e3-e2b0-40c2-b892-f442ec78a775'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:20.002728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'mac_address': 'fa:16:3e:e5:01:66', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:20.005526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 92fd08e3-e2b0-40c2-b892-f442ec78a775 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:20.006210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 92fd08e3-e2b0-40c2-b892-f442ec78a775 updated. Details: {'device': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'mac_address': 'fa:16:3e:e5:01:66', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:20.007909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-92fd08e3-e2, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:20.011800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-92fd08e3-e2, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:20.012735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-92fd08e3-e2, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:20.031778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-92fd08e3-e2, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:20.052074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d0c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:20.052700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:249 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 6 devices currently available. Time elapsed: 0.050 Oct 16 00:57:20.055353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:57:20.056023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'92fd08e3-e2b0-40c2-b892-f442ec78a775'} Oct 16 00:57:20.060691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:20.061685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:20.067934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:20.171463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a87c062-6e5c-4705-b405-5158cf3e65cf]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:20.173392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:249 - agent port security group processed in 0.171 Oct 16 00:57:20.174277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 92fd08e3-e2b0-40c2-b892-f442ec78a775 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:20.262653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-68372f02-1c6a-4af8-996e-16d75de4dd17 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:17Z,data_plane_status=None,description='',device_id='0fe95cc5-8422-458f-b86c-c45f224fe276',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=edc13d5b-c9f2-4dc4-a392-0e617cb7cd97,mac_address=fa:16:3e:65:3e:2c,name='',network_id=987da718-4a64-4801-99fd-c8b997ad845b,numa_affinity_policy=,project_id='c89fd0e945344feab91a37fdb93812e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(edc13d5b-c9f2-4dc4-a392-0e617cb7cd97),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:20.263157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-68372f02-1c6a-4af8-996e-16d75de4dd17 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (edc13d5b-c9f2-4dc4-a392-0e617cb7cd97), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:20.629170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-62f99dc6-9d84-4ecf-b49f-6e5a185aa439 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:19Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-7dae3d76-90a2-41d2-9dad-7f7856d5ab85',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=69a1bb27-221a-4f64-b9b2-e02c1194c2d4,mac_address=fa:16:3e:1f:8a:c2,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(69a1bb27-221a-4f64-b9b2-e02c1194c2d4),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:20.629710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-62f99dc6-9d84-4ecf-b49f-6e5a185aa439 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (69a1bb27-221a-4f64-b9b2-e02c1194c2d4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:20.916801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feb9ddc5-83b3-419a-a9ab-a413be78611f None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:18Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f6d9aa56-b330-4b62-a416-c067206c96f0',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=29057d15-832d-4bc1-939a-b77306acef22,mac_address=fa:16:3e:3b:c4:36,name='',network_id=f6d9aa56-b330-4b62-a416-c067206c96f0,numa_affinity_policy=,project_id='5462fcbfca114c8885f77f42b479b13d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(29057d15-832d-4bc1-939a-b77306acef22),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:20.917561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feb9ddc5-83b3-419a-a9ab-a413be78611f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (29057d15-832d-4bc1-939a-b77306acef22), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.229922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:20Z,description='Default security group',id=517414d0-4486-4ad1-9753-53fbc9abfcb5,is_default=True,name='default',project_id='1daba3a4330d42c8a14ccdf105b6738c',revision_number=1,rules=[SecurityGroupRule(20d7c2ca-bbbb-4057-a81c-545ecc44eb80),SecurityGroupRule(612cf10b-adc5-45be-b49e-3606c9bccc82),SecurityGroupRule(b6ddc16e-2ed6-49cc-a980-8bee1b63dd4f),SecurityGroupRule(cbc3e56d-4541-4dfd-a7e8-e832dca6e569)],shared=False,stateful=True,updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:21.232483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (517414d0-4486-4ad1-9753-53fbc9abfcb5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.238427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:20Z,description=,direction='ingress',ethertype='IPv4',id=20d7c2ca-bbbb-4057-a81c-545ecc44eb80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1daba3a4330d42c8a14ccdf105b6738c',protocol=,remote_address_group_id=,remote_group_id=517414d0-4486-4ad1-9753-53fbc9abfcb5,remote_ip_prefix=,revision_number=0,security_group_id=517414d0-4486-4ad1-9753-53fbc9abfcb5,updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:21.239171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (20d7c2ca-bbbb-4057-a81c-545ecc44eb80), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.239806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:21.241950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:20Z,description=,direction='egress',ethertype='IPv4',id=612cf10b-adc5-45be-b49e-3606c9bccc82,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1daba3a4330d42c8a14ccdf105b6738c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=517414d0-4486-4ad1-9753-53fbc9abfcb5,updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:21.242634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (612cf10b-adc5-45be-b49e-3606c9bccc82), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.243150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:21.244268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:20Z,description=,direction='egress',ethertype='IPv6',id=b6ddc16e-2ed6-49cc-a980-8bee1b63dd4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1daba3a4330d42c8a14ccdf105b6738c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=517414d0-4486-4ad1-9753-53fbc9abfcb5,updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:21.247824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b6ddc16e-2ed6-49cc-a980-8bee1b63dd4f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.250093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:21.253827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:20Z,description=,direction='ingress',ethertype='IPv6',id=cbc3e56d-4541-4dfd-a7e8-e832dca6e569,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1daba3a4330d42c8a14ccdf105b6738c',protocol=,remote_address_group_id=,remote_group_id=517414d0-4486-4ad1-9753-53fbc9abfcb5,remote_ip_prefix=,revision_number=0,security_group_id=517414d0-4486-4ad1-9753-53fbc9abfcb5,updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:21.254594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (cbc3e56d-4541-4dfd-a7e8-e832dca6e569), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.258596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:21.299779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Resource SecurityGroup deleted: 4fa51d52-91bc-479e-87c3-7ed0c2c8eb43 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:21.300467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (4fa51d52-91bc-479e-87c3-7ed0c2c8eb43), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.301043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4fa51d52-91bc-479e-87c3-7ed0c2c8eb43',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:21.556789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4fa51d52-91bc-479e-87c3-7ed0c2c8eb43',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:21.557544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Resource SecurityGroupRule deleted: 1a112ff5-6013-4b05-a18d-c74fabbae91e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:21.558092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1a112ff5-6013-4b05-a18d-c74fabbae91e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.558589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:21.559603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Resource SecurityGroupRule deleted: 60fcbd91-1add-4c39-8771-f9b402e6a4b0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:21.560333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (60fcbd91-1add-4c39-8771-f9b402e6a4b0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.561623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:21.562318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Resource SecurityGroupRule deleted: cdc51d1b-9da5-446f-bb7a-18035bff1386 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:21.562844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (cdc51d1b-9da5-446f-bb7a-18035bff1386), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.563347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:21.563894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Resource SecurityGroupRule deleted: f8e34c06-f9ce-48ad-8065-c61d4c75f61a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:21.564396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f8e34c06-f9ce-48ad-8065-c61d4c75f61a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.565251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e3cb92fc-7228-482d-8f5f-ed62b7bcaec1 admin admin] Security group rule updated ['4fa51d52-91bc-479e-87c3-7ed0c2c8eb43'] Oct 16 00:57:21.809867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-90edff89-831e-4acd-a30f-51dbd3503e29 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:20Z,data_plane_status=None,description='',device_id='289771a6-e20d-4d10-9549-b95a58061b22',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=42633501-06b6-4c52-92d4-45822c5b414e,mac_address=fa:16:3e:1d:66:42,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(42633501-06b6-4c52-92d4-45822c5b414e),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:21.810261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-90edff89-831e-4acd-a30f-51dbd3503e29 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (42633501-06b6-4c52-92d4-45822c5b414e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:21.933093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['92fd08e3-e2b0-40c2-b892-f442ec78a775'] and devices down [] completed. Oct 16 00:57:21.933339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:249 - ports processed. Elapsed:1.955 Oct 16 00:57:21.934026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:1.955 Oct 16 00:57:21.979741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:250 started Oct 16 00:57:21.989614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=629000000,duration_sec=508,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:21.991606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:21.992501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.013 Oct 16 00:57:22.005439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:22.013414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.034 Oct 16 00:57:22.016134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.036 Oct 16 00:57:22.121541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 92fd08e3-e2b0-40c2-b892-f442ec78a775 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=92fd08e3-e2b0-40c2-b892-f442ec78a775,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:22.122251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (92fd08e3-e2b0-40c2-b892-f442ec78a775), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:22.247309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:57:20Z,description='',dns_domain=None,id=6e18f0ac-4d59-43d4-adce-4e9589a88383,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-1839764876-network',project_id='1daba3a4330d42c8a14ccdf105b6738c',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(6e18f0ac-4d59-43d4-adce-4e9589a88383),segments=[NetworkSegment(8407501a-fa95-49f5-9584-6329097f15f8)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:57:21Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:22.248214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (6e18f0ac-4d59-43d4-adce-4e9589a88383), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:22.382651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-62f99dc6-9d84-4ecf-b49f-6e5a185aa439 None None] Resource Port 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=69a1bb27-221a-4f64-b9b2-e02c1194c2d4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=69a1bb27-221a-4f64-b9b2-e02c1194c2d4,segment=NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565),segment_id=994bcd7f-d2ee-4126-bfcb-b7cd5780c565)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=69a1bb27-221a-4f64-b9b2-e02c1194c2d4,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:22.383085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-62f99dc6-9d84-4ecf-b49f-6e5a185aa439 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (69a1bb27-221a-4f64-b9b2-e02c1194c2d4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:22.499705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4d358ad0-52a0-4a4f-945d-cdc33e6b25f9","insert","tap69a1bb27-22",["set",[]],["map",[["attached-mac","fa:16:3e:1f:8a:c2"],["iface-id","69a1bb27-221a-4f64-b9b2-e02c1194c2d4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:22.530651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4d358ad0-52a0-4a4f-945d-cdc33e6b25f9","old",null,["set",[]],null],["","new","tap69a1bb27-22",8,["map",[["attached-mac","fa:16:3e:1f:8a:c2"],["iface-id","69a1bb27-221a-4f64-b9b2-e02c1194c2d4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:22.563879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bfd6f8a9-b20b-48f8-9683-044db1522922","insert","tap29057d15-83",["set",[]],["map",[["attached-mac","fa:16:3e:3b:c4:36"],["iface-id","29057d15-832d-4bc1-939a-b77306acef22"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:22.612810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bfd6f8a9-b20b-48f8-9683-044db1522922","old",null,["set",[]],null],["","new","tap29057d15-83",9,["map",[["attached-mac","fa:16:3e:3b:c4:36"],["iface-id","29057d15-832d-4bc1-939a-b77306acef22"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-3b5996a4-530e-4cb7-b912-336177085424 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6e18f0ac-4d59-43d4-adce-4e9589a88383 with segmentation id not found. Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:57:22.679899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:57:22.681022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:57:22.681022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:57:22.681022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:57:22.681022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6e18f0ac-4d59-43d4-adce-4e9589a88383 with segmentation id not found. Oct 16 00:57:22.681022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:57:22.732019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-68372f02-1c6a-4af8-996e-16d75de4dd17 admin admin] Received resource Port update without any changes: edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 00:57:22.786966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feb9ddc5-83b3-419a-a9ab-a413be78611f None None] Resource Port 29057d15-832d-4bc1-939a-b77306acef22 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=29057d15-832d-4bc1-939a-b77306acef22,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=29057d15-832d-4bc1-939a-b77306acef22,segment=NetworkSegment(6387b2f2-0bee-4573-8938-2efc29213a5f),segment_id=6387b2f2-0bee-4573-8938-2efc29213a5f)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=29057d15-832d-4bc1-939a-b77306acef22,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:22.789231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feb9ddc5-83b3-419a-a9ab-a413be78611f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (29057d15-832d-4bc1-939a-b77306acef22), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:22.939324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5500fe84-fbf4-423e-bd68-94d79e27ccff None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:21Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-758abdbd-543f-42fe-8aa7-53af6cbbeb5d',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6e26ee91-59c3-4584-bc74-1d8a09fa7ed5,mac_address=fa:16:3e:c8:15:e5,name='',network_id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d,numa_affinity_policy=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6e26ee91-59c3-4584-bc74-1d8a09fa7ed5),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:22.939868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5500fe84-fbf4-423e-bd68-94d79e27ccff None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6e26ee91-59c3-4584-bc74-1d8a09fa7ed5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.013552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:22Z,description='Default security group',id=72323ba3-8782-4aed-934d-108eb5d5c76d,is_default=True,name='default',project_id='db213870f6a145cf9405415bdeb0a92b',revision_number=1,rules=[SecurityGroupRule(40b66dd4-a4dc-4068-aa71-535fd2a78c3b),SecurityGroupRule(b2511d53-7bcf-4107-9d96-2379d7b490d9),SecurityGroupRule(b622352e-546e-4f7e-8738-031e9250b097),SecurityGroupRule(d6ea33f0-f183-464f-ba54-bcd53459ccad)],shared=False,stateful=True,updated_at=2022-10-16T00:57:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:23.015266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (72323ba3-8782-4aed-934d-108eb5d5c76d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.016229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:22Z,description=,direction='ingress',ethertype='IPv6',id=40b66dd4-a4dc-4068-aa71-535fd2a78c3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db213870f6a145cf9405415bdeb0a92b',protocol=,remote_address_group_id=,remote_group_id=72323ba3-8782-4aed-934d-108eb5d5c76d,remote_ip_prefix=,revision_number=0,security_group_id=72323ba3-8782-4aed-934d-108eb5d5c76d,updated_at=2022-10-16T00:57:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:23.017265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (40b66dd4-a4dc-4068-aa71-535fd2a78c3b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.019896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:23.021255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:22Z,description=,direction='egress',ethertype='IPv6',id=b2511d53-7bcf-4107-9d96-2379d7b490d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db213870f6a145cf9405415bdeb0a92b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=72323ba3-8782-4aed-934d-108eb5d5c76d,updated_at=2022-10-16T00:57:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:23.023235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b2511d53-7bcf-4107-9d96-2379d7b490d9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.024085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:23.027870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:22Z,description=,direction='egress',ethertype='IPv4',id=b622352e-546e-4f7e-8738-031e9250b097,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db213870f6a145cf9405415bdeb0a92b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=72323ba3-8782-4aed-934d-108eb5d5c76d,updated_at=2022-10-16T00:57:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:23.028698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b622352e-546e-4f7e-8738-031e9250b097), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.029450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:23.032386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:22Z,description=,direction='ingress',ethertype='IPv4',id=d6ea33f0-f183-464f-ba54-bcd53459ccad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db213870f6a145cf9405415bdeb0a92b',protocol=,remote_address_group_id=,remote_group_id=72323ba3-8782-4aed-934d-108eb5d5c76d,remote_ip_prefix=,revision_number=0,security_group_id=72323ba3-8782-4aed-934d-108eb5d5c76d,updated_at=2022-10-16T00:57:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:23.033307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d6ea33f0-f183-464f-ba54-bcd53459ccad), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.034790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-827e5914-80fd-47dd-8838-18d818c207d1 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:23.313675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5500fe84-fbf4-423e-bd68-94d79e27ccff None None] Resource Port 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6e26ee91-59c3-4584-bc74-1d8a09fa7ed5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6e26ee91-59c3-4584-bc74-1d8a09fa7ed5,segment=NetworkSegment(dcee8df3-2008-4b96-bcaf-2c5a70d931e0),segment_id=dcee8df3-2008-4b96-bcaf-2c5a70d931e0)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6e26ee91-59c3-4584-bc74-1d8a09fa7ed5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:23.314901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5500fe84-fbf4-423e-bd68-94d79e27ccff None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6e26ee91-59c3-4584-bc74-1d8a09fa7ed5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.497039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c990cd9b-7a9a-4ee1-957b-7e59c9156991 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:20Z,data_plane_status=None,description='',device_id='04f2e7d9-6f59-4273-afb1-c6b961e608fe',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,mac_address=fa:16:3e:c8:27:1d,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a74fd78f-a45f-4321-a4ca-57d2bcba43d1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:23.498809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c990cd9b-7a9a-4ee1-957b-7e59c9156991 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a74fd78f-a45f-4321-a4ca-57d2bcba43d1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.716713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a2100145-5df0-4f84-91cb-e02f596985e3","insert","tap6e26ee91-59",["set",[]],["map",[["attached-mac","fa:16:3e:c8:15:e5"],["iface-id","6e26ee91-59c3-4584-bc74-1d8a09fa7ed5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:23.717882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a2100145-5df0-4f84-91cb-e02f596985e3","old",null,["set",[]],null],["","new","tap6e26ee91-59",10,["map",[["attached-mac","fa:16:3e:c8:15:e5"],["iface-id","6e26ee91-59c3-4584-bc74-1d8a09fa7ed5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:23.983323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:251 started Oct 16 00:57:23.986896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=629000000,duration_sec=510,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:23.987828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:23.988655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:251 - starting polling. Elapsed:0.006 Oct 16 00:57:23.990614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:23.993261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:251 - port information retrieved. Elapsed:0.010 Oct 16 00:57:23.999498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '831df3a8-d68b-40e9-b52b-297c2989e047', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '29057d15-832d-4bc1-939a-b77306acef22', '92fd08e3-e2b0-40c2-b892-f442ec78a775'}, 'added': {'29057d15-832d-4bc1-939a-b77306acef22', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4'}, 'removed': set(), 'updated': {'29057d15-832d-4bc1-939a-b77306acef22', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:24.000872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '29057d15-832d-4bc1-939a-b77306acef22', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': '29057d15-832d-4bc1-939a-b77306acef22', 'mac_address': 'fa:16:3e:3b:c4:36', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:24.001574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'mac_address': 'fa:16:3e:e5:01:66', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:24.002276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'mac_address': 'fa:16:3e:1f:8a:c2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:24.002956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'mac_address': 'fa:16:3e:c8:15:e5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:24.015045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 29057d15-832d-4bc1-939a-b77306acef22 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:24.015914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 29057d15-832d-4bc1-939a-b77306acef22 updated. Details: {'device': '29057d15-832d-4bc1-939a-b77306acef22', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': '29057d15-832d-4bc1-939a-b77306acef22', 'mac_address': 'fa:16:3e:3b:c4:36', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:57:24.016501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 5 as local vlan for net-id=f6d9aa56-b330-4b62-a416-c067206c96f0, seg-id=384 Oct 16 00:57:24.026669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c85,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4480), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.037700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416d12,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4480}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.040789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap29057d15-83, col_values=(('tag', 5),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.043079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap29057d15-83, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.043922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap29057d15-83, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.081693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Resource SecurityGroup deleted: 72323ba3-8782-4aed-934d-108eb5d5c76d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:24.082085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (72323ba3-8782-4aed-934d-108eb5d5c76d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:24.087105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('72323ba3-8782-4aed-934d-108eb5d5c76d',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:24.137374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap29057d15-83, col_values=(('other_config', {'net_uuid': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '384'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.203162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('72323ba3-8782-4aed-934d-108eb5d5c76d',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:24.208610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Resource SecurityGroupRule deleted: 40b66dd4-a4dc-4068-aa71-535fd2a78c3b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:24.222293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (40b66dd4-a4dc-4068-aa71-535fd2a78c3b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:24.223270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:24.224179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Resource SecurityGroupRule deleted: b2511d53-7bcf-4107-9d96-2379d7b490d9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:24.225266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b2511d53-7bcf-4107-9d96-2379d7b490d9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:24.235473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:24.238242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Resource SecurityGroupRule deleted: b622352e-546e-4f7e-8738-031e9250b097 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:24.240963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b622352e-546e-4f7e-8738-031e9250b097), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:24.242114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:24.243494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Resource SecurityGroupRule deleted: d6ea33f0-f183-464f-ba54-bcd53459ccad {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:24.250556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d6ea33f0-f183-464f-ba54-bcd53459ccad), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:24.255024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a56b0e76-d46e-4a96-ad66-23524fdd6ac4 admin admin] Security group rule updated ['72323ba3-8782-4aed-934d-108eb5d5c76d'] Oct 16 00:57:24.265068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d14,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.266083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 92fd08e3-e2b0-40c2-b892-f442ec78a775 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:24.267171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 92fd08e3-e2b0-40c2-b892-f442ec78a775 updated. Details: {'device': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'mac_address': 'fa:16:3e:e5:01:66', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:24.270100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-92fd08e3-e2, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.271286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-92fd08e3-e2, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.272244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-92fd08e3-e2, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.273409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:24.276718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-92fd08e3-e2, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.278703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:24.287948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d16,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.289171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:24.289996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 updated. Details: {'device': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'mac_address': 'fa:16:3e:1f:8a:c2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:57:24.291348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 6 as local vlan for net-id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85, seg-id=354 Oct 16 00:57:24.299406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c87,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4450), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.308462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416d18,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4450}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.311434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap69a1bb27-22, col_values=(('tag', 6),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.313067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap69a1bb27-22, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.327483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap69a1bb27-22, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.356976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap69a1bb27-22, col_values=(('other_config', {'net_uuid': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '354'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.383712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d1a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.384891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:24.386311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 updated. Details: {'device': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'mac_address': 'fa:16:3e:c8:15:e5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:57:24.389801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 7 as local vlan for net-id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d, seg-id=376 Oct 16 00:57:24.410686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c89,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4472), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.423831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416d1c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4472}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.427101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6e26ee91-59, col_values=(('tag', 7),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.432298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6e26ee91-59, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.436298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6e26ee91-59, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.460794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6e26ee91-59, col_values=(('other_config', {'net_uuid': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '376'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:24.490580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-51590dce-d52d-4789-981d-c5091a5056ce admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(99e5e835-2c2b-43ab-87fd-328c329f4806)],cidr=172.20.0.0/28,created_at=2022-10-16T00:57:23Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=c149cb03-b614-4e6f-b3b4-33bba9271b51,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-1839764876-subnet',network_id=6e18f0ac-4d59-43d4-adce-4e9589a88383,project_id='1daba3a4330d42c8a14ccdf105b6738c',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:57:23Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:24.493453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-51590dce-d52d-4789-981d-c5091a5056ce admin admin] Publish callbacks [] for Subnet (c149cb03-b614-4e6f-b3b4-33bba9271b51), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:24.523031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d1e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:24.526320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:251 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.526 Oct 16 00:57:24.526714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 3 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:57:24.529869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'29057d15-832d-4bc1-939a-b77306acef22', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4'} Oct 16 00:57:24.532899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:24.533584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:24.541922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 6 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:24.684738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c860d89-79e2-40b9-8546-e7f09c5fd765]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:24.685457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:57:24.685726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:57:24.687163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:24.687461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:24.690555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:24.801977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc3c230-3187-4c04-b759-db6334db1474]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:24.802638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:251 - agent port security group processed in 0.802 Oct 16 00:57:24.803510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 29057d15-832d-4bc1-939a-b77306acef22 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:24.803824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 92fd08e3-e2b0-40c2-b892-f442ec78a775 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:24.804153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:24.804456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:25.111838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-16350988-2ab0-4a1e-ac19-1be5707e8720 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:22Z,data_plane_status=None,description='',device_id='66966500-9f64-45ff-98f6-e8d186878a55',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,mac_address=fa:16:3e:00:91:af,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(71efdb3f-9c56-4a2c-8049-f6c1d0baa573),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:23Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:25.112251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-16350988-2ab0-4a1e-ac19-1be5707e8720 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (71efdb3f-9c56-4a2c-8049-f6c1d0baa573), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:26.134661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-296aa04b-261f-4d02-a887-3c3b4775e57f admin admin] Resource Subnet deleted: 2cc1effe-1348-4c66-90fa-b8e4bc5b9dca {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:26.135782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-296aa04b-261f-4d02-a887-3c3b4775e57f admin admin] Publish callbacks [] for Subnet (2cc1effe-1348-4c66-90fa-b8e4bc5b9dca), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:27.580921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2004ee94-632d-4b87-8eb5-2144e25d3e07 None None] Resource Port 42633501-06b6-4c52-92d4-45822c5b414e updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=42633501-06b6-4c52-92d4-45822c5b414e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=42633501-06b6-4c52-92d4-45822c5b414e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:27.581920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2004ee94-632d-4b87-8eb5-2144e25d3e07 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (42633501-06b6-4c52-92d4-45822c5b414e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:28.248531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2004ee94-632d-4b87-8eb5-2144e25d3e07 None None] Resource Port 42633501-06b6-4c52-92d4-45822c5b414e updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=42633501-06b6-4c52-92d4-45822c5b414e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=42633501-06b6-4c52-92d4-45822c5b414e,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=42633501-06b6-4c52-92d4-45822c5b414e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:28.249561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2004ee94-632d-4b87-8eb5-2144e25d3e07 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (42633501-06b6-4c52-92d4-45822c5b414e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:28.468197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7dbc239c-060a-4773-a44d-2b0ad264bb5f admin admin] Resource Network deleted: 62c35b48-ed00-45fe-9f3a-baf6863ebf0f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:28.469253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7dbc239c-060a-4773-a44d-2b0ad264bb5f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (62c35b48-ed00-45fe-9f3a-baf6863ebf0f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:29.505341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b13bccb3-d36a-4120-aa91-aa93b8a8352b","insert","qg-42633501-06",["set",[]],["map",[["attached-mac","fa:16:3e:1d:66:42"],["iface-id","42633501-06b6-4c52-92d4-45822c5b414e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:29.534104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b13bccb3-d36a-4120-aa91-aa93b8a8352b","old",null,["set",[]],null],["","new","qg-42633501-06",11,["map",[["attached-mac","fa:16:3e:1d:66:42"],["iface-id","42633501-06b6-4c52-92d4-45822c5b414e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:29.665330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7a675c30-528d-46da-b7e1-443eabe2bd51 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:28Z,data_plane_status=None,description='',device_id='289771a6-e20d-4d10-9549-b95a58061b22',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6,mac_address=fa:16:3e:5c:27:e8,name='',network_id=f6d9aa56-b330-4b62-a416-c067206c96f0,numa_affinity_policy=,project_id='5462fcbfca114c8885f77f42b479b13d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:28Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:29.665330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7a675c30-528d-46da-b7e1-443eabe2bd51 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:29.697051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a721b589-e563-4bac-b727-a70853c942dd admin admin] Resource Subnet deleted: c149cb03-b614-4e6f-b3b4-33bba9271b51 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:29.699779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a721b589-e563-4bac-b727-a70853c942dd admin admin] Publish callbacks [] for Subnet (c149cb03-b614-4e6f-b3b4-33bba9271b51), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:30.697349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-962b3047-a43c-4886-9c74-1ed48fc3ec7a None None] Resource Port 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:30.698354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-962b3047-a43c-4886-9c74-1ed48fc3ec7a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (69a1bb27-221a-4f64-b9b2-e02c1194c2d4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:31.187590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f0434b33-4c1a-4308-9953-9a35b23d3cf4 None None] Resource Port 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:31.187992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f0434b33-4c1a-4308-9953-9a35b23d3cf4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (71efdb3f-9c56-4a2c-8049-f6c1d0baa573), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:31.799578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f0434b33-4c1a-4308-9953-9a35b23d3cf4 None None] Resource Port 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:31.800264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f0434b33-4c1a-4308-9953-9a35b23d3cf4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (71efdb3f-9c56-4a2c-8049-f6c1d0baa573), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:31.931356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 29057d15-832d-4bc1-939a-b77306acef22 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:31.931759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (29057d15-832d-4bc1-939a-b77306acef22), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:32.255978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7a675c30-528d-46da-b7e1-443eabe2bd51 admin admin] Received resource Port update without any changes: d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 00:57:32.335839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-63de61b5-e98e-48ad-ad06-c0fad12ca42b admin admin] Resource Network deleted: 6e18f0ac-4d59-43d4-adce-4e9589a88383 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:32.336514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-63de61b5-e98e-48ad-ad06-c0fad12ca42b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (6e18f0ac-4d59-43d4-adce-4e9589a88383), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:32.516918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-83223cd9-48c8-4db1-ae6a-31f64f19eb8f None None] Resource Port edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=edc13d5b-c9f2-4dc4-a392-0e617cb7cd97,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=edc13d5b-c9f2-4dc4-a392-0e617cb7cd97,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:32.517863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-83223cd9-48c8-4db1-ae6a-31f64f19eb8f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (edc13d5b-c9f2-4dc4-a392-0e617cb7cd97), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.112427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6a87c578-5a9d-438c-8c51-4558b8fe95f9 None None] Resource Port a74fd78f-a45f-4321-a4ca-57d2bcba43d1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:33.113549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6a87c578-5a9d-438c-8c51-4558b8fe95f9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a74fd78f-a45f-4321-a4ca-57d2bcba43d1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.161193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-56976a1f-bf7f-4107-8d69-da53b7f745ba admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:30Z,data_plane_status=None,description='',device_id='04f2e7d9-6f59-4273-afb1-c6b961e608fe',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,mac_address=fa:16:3e:27:e4:1b,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1243eb6a-8f6b-4732-b89b-091ec46b2b6d),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:33.161582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-56976a1f-bf7f-4107-8d69-da53b7f745ba admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1243eb6a-8f6b-4732-b89b-091ec46b2b6d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.234276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["28ea11d4-4853-423d-b3ad-5cf75ed3a669","insert","qg-71efdb3f-9c",["set",[]],["map",[["attached-mac","fa:16:3e:00:91:af"],["iface-id","71efdb3f-9c56-4a2c-8049-f6c1d0baa573"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:33.251973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["28ea11d4-4853-423d-b3ad-5cf75ed3a669","old",null,["set",[]],null],["","new","qg-71efdb3f-9c",12,["map",[["attached-mac","fa:16:3e:00:91:af"],["iface-id","71efdb3f-9c56-4a2c-8049-f6c1d0baa573"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:33.305052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:32Z,description='Default security group',id=61695819-64ec-4289-8b63-c2431d1ac482,is_default=True,name='default',project_id='ce82a4cafaac4ccb82a0e07c3212584f',revision_number=1,rules=[SecurityGroupRule(37215467-58a5-4fdb-b563-2d436dc0a08e),SecurityGroupRule(663119a8-047c-4841-8982-f9e2eb01fb79),SecurityGroupRule(b60c1e85-29a6-4b48-8836-bf6f6921860c),SecurityGroupRule(bcf7a241-ac4b-485d-9f07-816f54b9110f)],shared=False,stateful=True,updated_at=2022-10-16T00:57:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:33.305447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (61695819-64ec-4289-8b63-c2431d1ac482), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.307911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:32Z,description=,direction='ingress',ethertype='IPv4',id=37215467-58a5-4fdb-b563-2d436dc0a08e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce82a4cafaac4ccb82a0e07c3212584f',protocol=,remote_address_group_id=,remote_group_id=61695819-64ec-4289-8b63-c2431d1ac482,remote_ip_prefix=,revision_number=0,security_group_id=61695819-64ec-4289-8b63-c2431d1ac482,updated_at=2022-10-16T00:57:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:33.308624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (37215467-58a5-4fdb-b563-2d436dc0a08e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.309135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:33.310015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:32Z,description=,direction='egress',ethertype='IPv4',id=663119a8-047c-4841-8982-f9e2eb01fb79,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce82a4cafaac4ccb82a0e07c3212584f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=61695819-64ec-4289-8b63-c2431d1ac482,updated_at=2022-10-16T00:57:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:33.310545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (663119a8-047c-4841-8982-f9e2eb01fb79), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.311077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:33.312209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:32Z,description=,direction='egress',ethertype='IPv6',id=b60c1e85-29a6-4b48-8836-bf6f6921860c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce82a4cafaac4ccb82a0e07c3212584f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=61695819-64ec-4289-8b63-c2431d1ac482,updated_at=2022-10-16T00:57:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:33.312841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b60c1e85-29a6-4b48-8836-bf6f6921860c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.313329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:33.314204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:32Z,description=,direction='ingress',ethertype='IPv6',id=bcf7a241-ac4b-485d-9f07-816f54b9110f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce82a4cafaac4ccb82a0e07c3212584f',protocol=,remote_address_group_id=,remote_group_id=61695819-64ec-4289-8b63-c2431d1ac482,remote_ip_prefix=,revision_number=0,security_group_id=61695819-64ec-4289-8b63-c2431d1ac482,updated_at=2022-10-16T00:57:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:33.314718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bcf7a241-ac4b-485d-9f07-816f54b9110f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:33.315252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7f7427a0-0d15-469f-8a36-da73381e45e4 admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:33.587344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dee72722-457f-4c76-bf90-d1ab50976f3f None None] Resource Port 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:33.587880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dee72722-457f-4c76-bf90-d1ab50976f3f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6e26ee91-59c3-4584-bc74-1d8a09fa7ed5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.175160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Resource SecurityGroup deleted: 61695819-64ec-4289-8b63-c2431d1ac482 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:34.176436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (61695819-64ec-4289-8b63-c2431d1ac482), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.177608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('61695819-64ec-4289-8b63-c2431d1ac482',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:34.286098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cb81f29-b030-4621-bcc9-2fbc75a3011a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:33Z,data_plane_status=None,description='',device_id='66966500-9f64-45ff-98f6-e8d186878a55',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3a245083-425c-44d7-b1c7-ff24d35e844e,mac_address=fa:16:3e:c1:95:0e,name='',network_id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d,numa_affinity_policy=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3a245083-425c-44d7-b1c7-ff24d35e844e),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:33Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:34.286921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cb81f29-b030-4621-bcc9-2fbc75a3011a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3a245083-425c-44d7-b1c7-ff24d35e844e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.476463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-56976a1f-bf7f-4107-8d69-da53b7f745ba admin admin] Received resource Port update without any changes: 1243eb6a-8f6b-4732-b89b-091ec46b2b6d {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 00:57:34.531185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('61695819-64ec-4289-8b63-c2431d1ac482',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:34.531774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Resource SecurityGroupRule deleted: 37215467-58a5-4fdb-b563-2d436dc0a08e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:34.532484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (37215467-58a5-4fdb-b563-2d436dc0a08e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.533301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:34.533800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Resource SecurityGroupRule deleted: 663119a8-047c-4841-8982-f9e2eb01fb79 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:34.534322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (663119a8-047c-4841-8982-f9e2eb01fb79), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.534748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:34.535247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Resource SecurityGroupRule deleted: b60c1e85-29a6-4b48-8836-bf6f6921860c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:34.535818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b60c1e85-29a6-4b48-8836-bf6f6921860c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.536358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:34.536930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Resource SecurityGroupRule deleted: bcf7a241-ac4b-485d-9f07-816f54b9110f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:34.537505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bcf7a241-ac4b-485d-9f07-816f54b9110f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.538032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88aea5b2-c225-4bc3-8d98-e288136cd3cf admin admin] Security group rule updated ['61695819-64ec-4289-8b63-c2431d1ac482'] Oct 16 00:57:34.550490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6a87c578-5a9d-438c-8c51-4558b8fe95f9 None None] Resource Port a74fd78f-a45f-4321-a4ca-57d2bcba43d1 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:34.551362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6a87c578-5a9d-438c-8c51-4558b8fe95f9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a74fd78f-a45f-4321-a4ca-57d2bcba43d1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.627375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Resource SecurityGroup deleted: 2114e761-d924-4615-a343-717baad55944 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:34.628029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (2114e761-d924-4615-a343-717baad55944), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:34.628731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2114e761-d924-4615-a343-717baad55944',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:34.732442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-83223cd9-48c8-4db1-ae6a-31f64f19eb8f None None] Resource Port edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=edc13d5b-c9f2-4dc4-a392-0e617cb7cd97,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=edc13d5b-c9f2-4dc4-a392-0e617cb7cd97,segment=NetworkSegment(ebb1560a-1126-4b15-8db8-f323ab73a037),segment_id=ebb1560a-1126-4b15-8db8-f323ab73a037)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=edc13d5b-c9f2-4dc4-a392-0e617cb7cd97,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:34.733417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-83223cd9-48c8-4db1-ae6a-31f64f19eb8f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (edc13d5b-c9f2-4dc4-a392-0e617cb7cd97), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.151927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2114e761-d924-4615-a343-717baad55944',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:35.152496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Resource SecurityGroupRule deleted: 6cf9e2ac-5779-4ba8-b711-d8f760dfdf07 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:35.152963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6cf9e2ac-5779-4ba8-b711-d8f760dfdf07), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.153382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:35.153880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Resource SecurityGroupRule deleted: 96c0ee9c-06b6-4bfa-8b39-962e49e3f12d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:35.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (96c0ee9c-06b6-4bfa-8b39-962e49e3f12d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.155026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:35.155537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Resource SecurityGroupRule deleted: c338de55-fe28-498b-985a-dc26c07d0c32 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:35.156037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c338de55-fe28-498b-985a-dc26c07d0c32), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.165086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:35.165641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Resource SecurityGroupRule deleted: ec990a23-582c-4870-b4fb-15d4260ac398 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:35.166019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ec990a23-582c-4870-b4fb-15d4260ac398), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.166358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6cbbe1dc-bfe3-409d-a11a-14de2affff2d admin admin] Security group rule updated ['2114e761-d924-4615-a343-717baad55944'] Oct 16 00:57:35.245762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:34Z,description='Default security group',id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,is_default=True,name='default',project_id='7d6e0d35b8394e6fb979a7ba3544d31f',revision_number=1,rules=[SecurityGroupRule(460ccadd-2eb4-4e41-add0-f1ee0283658d),SecurityGroupRule(6cd2d9be-90eb-4ad4-a5ce-820a3cc757b1),SecurityGroupRule(84230145-beb5-4783-9d94-5b1eab0ec51d),SecurityGroupRule(e6ee4881-4ac5-4640-923b-3695df2926a7)],shared=False,stateful=True,updated_at=2022-10-16T00:57:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:35.246392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.246820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:34Z,description=,direction='egress',ethertype='IPv4',id=460ccadd-2eb4-4e41-add0-f1ee0283658d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d6e0d35b8394e6fb979a7ba3544d31f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,updated_at=2022-10-16T00:57:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:35.247210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (460ccadd-2eb4-4e41-add0-f1ee0283658d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.248157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:35.248891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:34Z,description=,direction='egress',ethertype='IPv6',id=6cd2d9be-90eb-4ad4-a5ce-820a3cc757b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d6e0d35b8394e6fb979a7ba3544d31f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,updated_at=2022-10-16T00:57:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:35.249289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6cd2d9be-90eb-4ad4-a5ce-820a3cc757b1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.249793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:35.250310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:34Z,description=,direction='ingress',ethertype='IPv4',id=84230145-beb5-4783-9d94-5b1eab0ec51d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d6e0d35b8394e6fb979a7ba3544d31f',protocol=,remote_address_group_id=,remote_group_id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,remote_ip_prefix=,revision_number=0,security_group_id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,updated_at=2022-10-16T00:57:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:35.251110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (84230145-beb5-4783-9d94-5b1eab0ec51d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.263321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:35.266194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:34Z,description=,direction='ingress',ethertype='IPv6',id=e6ee4881-4ac5-4640-923b-3695df2926a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d6e0d35b8394e6fb979a7ba3544d31f',protocol=,remote_address_group_id=,remote_group_id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,remote_ip_prefix=,revision_number=0,security_group_id=cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26,updated_at=2022-10-16T00:57:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:35.266767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e6ee4881-4ac5-4640-923b-3695df2926a7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.267310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7d1681d-c4cb-44bb-a5fd-e67d3607b113 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:35.755300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Resource SecurityGroup deleted: cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:35.755755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:35.756539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:36.194427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['29057d15-832d-4bc1-939a-b77306acef22', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5'] and devices down [] completed. Oct 16 00:57:36.194775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:251 - ports processed. Elapsed:12.212 Oct 16 00:57:36.195234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 4, 'removed': 0}}. Elapsed:12.212 Oct 16 00:57:36.196352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Loop iteration exceeded interval (2 vs. 12.212117195129395)! {{(pid=105601) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 16 00:57:36.196647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:252 started Oct 16 00:57:36.201342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=842000000,duration_sec=522,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:36.202235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:36.202779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:252 - starting polling. Elapsed:0.006 Oct 16 00:57:36.214701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:36.233562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:252 - port information retrieved. Elapsed:0.037 Oct 16 00:57:36.236081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '831df3a8-d68b-40e9-b52b-297c2989e047', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '29057d15-832d-4bc1-939a-b77306acef22', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': {'71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'removed': set(), 'updated': {'69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '29057d15-832d-4bc1-939a-b77306acef22', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:36.238726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '29057d15-832d-4bc1-939a-b77306acef22', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': '29057d15-832d-4bc1-939a-b77306acef22', 'mac_address': 'fa:16:3e:3b:c4:36', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:36.240518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'mac_address': 'fa:16:3e:00:91:af', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.152'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:36.242432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'mac_address': 'fa:16:3e:1f:8a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:36.257167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '42633501-06b6-4c52-92d4-45822c5b414e', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '42633501-06b6-4c52-92d4-45822c5b414e', 'mac_address': 'fa:16:3e:1d:66:42', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.181'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:36.259700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'mac_address': 'fa:16:3e:c8:15:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:36.262664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 29057d15-832d-4bc1-939a-b77306acef22 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:36.271813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 29057d15-832d-4bc1-939a-b77306acef22 updated. Details: {'device': '29057d15-832d-4bc1-939a-b77306acef22', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': '29057d15-832d-4bc1-939a-b77306acef22', 'mac_address': 'fa:16:3e:3b:c4:36', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 16 00:57:36.273283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap29057d15-83, col_values=(('tag', 5),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.277784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap29057d15-83, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.283989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap29057d15-83, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.285386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:36.293421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap29057d15-83, col_values=(('other_config', {'net_uuid': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '384', 'tag': '5'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.300103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:36.312562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d22,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:36.319997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:36.320579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 updated. Details: {'device': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'mac_address': 'fa:16:3e:00:91:af', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.152'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:36.328198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-71efdb3f-9c, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.329394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-71efdb3f-9c, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.331380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-71efdb3f-9c, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.353912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-71efdb3f-9c, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.381522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d24,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:36.383306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:36.384797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 updated. Details: {'device': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'mac_address': 'fa:16:3e:1f:8a:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 16 00:57:36.392377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap69a1bb27-22, col_values=(('tag', 6),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.393077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap69a1bb27-22, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.400388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap69a1bb27-22, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.402775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:36.408821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap69a1bb27-22, col_values=(('other_config', {'net_uuid': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '354', 'tag': '6'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.410772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:36.426075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cb81f29-b030-4621-bcc9-2fbc75a3011a admin admin] Received resource Port update without any changes: 3a245083-425c-44d7-b1c7-ff24d35e844e {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 00:57:36.439277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:36.443848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Resource SecurityGroupRule deleted: 460ccadd-2eb4-4e41-add0-f1ee0283658d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:36.449971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (460ccadd-2eb4-4e41-add0-f1ee0283658d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:36.452815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:36.454142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Resource SecurityGroupRule deleted: 6cd2d9be-90eb-4ad4-a5ce-820a3cc757b1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:36.455285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6cd2d9be-90eb-4ad4-a5ce-820a3cc757b1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:36.461558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:36.470380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Resource SecurityGroupRule deleted: 84230145-beb5-4783-9d94-5b1eab0ec51d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:36.471204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (84230145-beb5-4783-9d94-5b1eab0ec51d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:36.471513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:36.471825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Resource SecurityGroupRule deleted: e6ee4881-4ac5-4640-923b-3695df2926a7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:36.472184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e6ee4881-4ac5-4640-923b-3695df2926a7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:36.472547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89cf74b6-538b-4192-bd54-0af40ae6cf56 admin admin] Security group rule updated ['cd80f2e6-9abd-4d00-bfb3-edee4f0a6b26'] Oct 16 00:57:36.494190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d26,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:36.495068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 42633501-06b6-4c52-92d4-45822c5b414e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:36.495418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 42633501-06b6-4c52-92d4-45822c5b414e updated. Details: {'device': '42633501-06b6-4c52-92d4-45822c5b414e', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '42633501-06b6-4c52-92d4-45822c5b414e', 'mac_address': 'fa:16:3e:1d:66:42', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.181'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:36.501579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-42633501-06, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.503193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-42633501-06, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.504666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-42633501-06, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.538704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-42633501-06, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.575252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d28,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:36.575679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:36.576025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 updated. Details: {'device': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', 'mac_address': 'fa:16:3e:c8:15:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 16 00:57:36.580193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6e26ee91-59, col_values=(('tag', 7),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.587217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6e26ee91-59, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.587830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6e26ee91-59, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.588458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:36.589705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6e26ee91-59, col_values=(('other_config', {'net_uuid': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '376', 'tag': '7'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:36.592918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:36.600516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d2a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:36.601246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:252 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.365 Oct 16 00:57:36.602838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 2 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:57:36.608584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'} Oct 16 00:57:36.614483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:36.616266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:36.630701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:36.774093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Resource SecurityGroup deleted: 517414d0-4486-4ad1-9753-53fbc9abfcb5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:36.774483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (517414d0-4486-4ad1-9753-53fbc9abfcb5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:36.775037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('517414d0-4486-4ad1-9753-53fbc9abfcb5',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:36.784712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0e6314-30c1-4cbb-b052-cab804a6e756]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:36.789526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 3 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:57:36.790676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:57:36.799566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:36.800127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:36.818681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 6 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:36.956331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[9939efce-9886-4ebe-b8a8-cb65fa720da0]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:36.957604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:252 - agent port security group processed in 0.721 Oct 16 00:57:36.958495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 29057d15-832d-4bc1-939a-b77306acef22 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:36.958804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:36.960767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:36.960767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 42633501-06b6-4c52-92d4-45822c5b414e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:36.960767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:37.183455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('517414d0-4486-4ad1-9753-53fbc9abfcb5',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:37.184504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Resource SecurityGroupRule deleted: 20d7c2ca-bbbb-4057-a81c-545ecc44eb80 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:37.186623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (20d7c2ca-bbbb-4057-a81c-545ecc44eb80), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:37.190228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:37.192934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Resource SecurityGroupRule deleted: 612cf10b-adc5-45be-b49e-3606c9bccc82 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:37.193702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (612cf10b-adc5-45be-b49e-3606c9bccc82), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:37.194535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:37.196620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Resource SecurityGroupRule deleted: b6ddc16e-2ed6-49cc-a980-8bee1b63dd4f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:37.197164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b6ddc16e-2ed6-49cc-a980-8bee1b63dd4f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:37.197823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:37.198337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Resource SecurityGroupRule deleted: cbc3e56d-4541-4dfd-a7e8-e832dca6e569 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:37.199268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (cbc3e56d-4541-4dfd-a7e8-e832dca6e569), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:37.203955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2daeb09f-94d5-47aa-8a30-22f0f3d0014b admin admin] Security group rule updated ['517414d0-4486-4ad1-9753-53fbc9abfcb5'] Oct 16 00:57:37.596415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18e3c196-229b-42dd-b5ca-214f116acef6","insert","qr-edc13d5b-c9",["set",[]],["map",[["attached-mac","fa:16:3e:65:3e:2c"],["iface-id","edc13d5b-c9f2-4dc4-a392-0e617cb7cd97"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:37.627407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18e3c196-229b-42dd-b5ca-214f116acef6","old",null,["set",[]],null],["","new","qr-edc13d5b-c9",13,["map",[["attached-mac","fa:16:3e:65:3e:2c"],["iface-id","edc13d5b-c9f2-4dc4-a392-0e617cb7cd97"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:37.765785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4bb07573-05a3-4cb1-beb4-5799351fb3f5","insert","qr-1243eb6a-8f",["set",[]],["map",[["attached-mac","fa:16:3e:27:e4:1b"],["iface-id","1243eb6a-8f6b-4732-b89b-091ec46b2b6d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:37.791640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4bb07573-05a3-4cb1-beb4-5799351fb3f5","old",null,["set",[]],null],["","new","qr-1243eb6a-8f",14,["map",[["attached-mac","fa:16:3e:27:e4:1b"],["iface-id","1243eb6a-8f6b-4732-b89b-091ec46b2b6d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:38.874145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:37Z,description='tempest-description--1805274243',id=0aa46afa-7cf8-4516-97b1-1f6d9484df92,is_default=False,name='tempest-securitygroup--1921163935',project_id='fb3c758e27684dcd9265e2d60036d80b',revision_number=1,rules=[SecurityGroupRule(1c94e101-b1a3-4aaf-ab10-3b01c8f520bf),SecurityGroupRule(b1c1ce1e-78cd-4c92-9e60-295cc70ff3a9)],shared=False,stateful=True,updated_at=2022-10-16T00:57:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:38.874815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (0aa46afa-7cf8-4516-97b1-1f6d9484df92), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:38.875488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:38Z,description=,direction='egress',ethertype='IPv6',id=1c94e101-b1a3-4aaf-ab10-3b01c8f520bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0aa46afa-7cf8-4516-97b1-1f6d9484df92,updated_at=2022-10-16T00:57:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:38.875871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1c94e101-b1a3-4aaf-ab10-3b01c8f520bf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:38.876217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 00:57:38.876914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:38Z,description=,direction='egress',ethertype='IPv4',id=b1c1ce1e-78cd-4c92-9e60-295cc70ff3a9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0aa46afa-7cf8-4516-97b1-1f6d9484df92,updated_at=2022-10-16T00:57:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:38.877277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b1c1ce1e-78cd-4c92-9e60-295cc70ff3a9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:38.877610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-aac252f2-5ece-42a4-a6cd-0d35ac83983a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 00:57:39.160571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["66872696-ce37-4e88-aea1-931fa1360082","insert","qg-a74fd78f-a4",["set",[]],["map",[["attached-mac","fa:16:3e:c8:27:1d"],["iface-id","a74fd78f-a45f-4321-a4ca-57d2bcba43d1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:39.161626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["66872696-ce37-4e88-aea1-931fa1360082","old",null,["set",[]],null],["","new","qg-a74fd78f-a4",15,["map",[["attached-mac","fa:16:3e:c8:27:1d"],["iface-id","a74fd78f-a45f-4321-a4ca-57d2bcba43d1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:39.799991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2fa8315e-8a5e-42c0-9305-4a4a29acd042 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:39Z,description='',direction='ingress',ethertype='IPv4',id=6466298f-835c-4a28-95f2-a901b7a26cef,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0aa46afa-7cf8-4516-97b1-1f6d9484df92,updated_at=2022-10-16T00:57:39Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:39.800515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2fa8315e-8a5e-42c0-9305-4a4a29acd042 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6466298f-835c-4a28-95f2-a901b7a26cef), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:39.800874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2fa8315e-8a5e-42c0-9305-4a4a29acd042 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 00:57:40.433509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=71efdb3f-9c56-4a2c-8049-f6c1d0baa573,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:40.434188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (71efdb3f-9c56-4a2c-8049-f6c1d0baa573), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:40.775995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6703fe8-1cdb-4a85-a9ad-3829b503968e None None] Resource Port 3a245083-425c-44d7-b1c7-ff24d35e844e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=3a245083-425c-44d7-b1c7-ff24d35e844e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3a245083-425c-44d7-b1c7-ff24d35e844e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:40.776777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6703fe8-1cdb-4a85-a9ad-3829b503968e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3a245083-425c-44d7-b1c7-ff24d35e844e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:40.844393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:40Z,description='tempest-description--1700305816',id=d93458da-7a02-4d80-8695-660bb21543cd,is_default=False,name='tempest-securitygroup--977466123',project_id='cca355ef4a294ecd88cc299b7e0ca9d8',revision_number=1,rules=[SecurityGroupRule(4d5e18df-9c97-47e0-a54b-c66c5a50bb4f),SecurityGroupRule(be9a3d44-b7f9-4204-a809-bc052b15a2f1)],shared=False,stateful=True,updated_at=2022-10-16T00:57:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:40.845205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (d93458da-7a02-4d80-8695-660bb21543cd), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:40.846302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:40Z,description=,direction='egress',ethertype='IPv4',id=4d5e18df-9c97-47e0-a54b-c66c5a50bb4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d93458da-7a02-4d80-8695-660bb21543cd,updated_at=2022-10-16T00:57:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:40.846799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4d5e18df-9c97-47e0-a54b-c66c5a50bb4f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:40.847390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 00:57:40.848305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:40Z,description=,direction='egress',ethertype='IPv6',id=be9a3d44-b7f9-4204-a809-bc052b15a2f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d93458da-7a02-4d80-8695-660bb21543cd,updated_at=2022-10-16T00:57:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:40.848989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (be9a3d44-b7f9-4204-a809-bc052b15a2f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:40.849385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-91276e57-3cad-4ca3-99bc-0301d645e60f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 00:57:41.103128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7cf3bd6a-be2f-477d-80ad-bc930df18672 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:40Z,description='',direction='ingress',ethertype='IPv4',id=90d74311-4dce-4798-a304-3882de5fcc8d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0aa46afa-7cf8-4516-97b1-1f6d9484df92,updated_at=2022-10-16T00:57:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:41.103625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7cf3bd6a-be2f-477d-80ad-bc930df18672 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (90d74311-4dce-4798-a304-3882de5fcc8d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:41.104101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7cf3bd6a-be2f-477d-80ad-bc930df18672 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 00:57:41.435955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9b70c9d6-2223-43b7-83de-57a219249145 None None] Resource Port d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:41.437097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9b70c9d6-2223-43b7-83de-57a219249145 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:41.979128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9b70c9d6-2223-43b7-83de-57a219249145 None None] Resource Port d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6,segment=NetworkSegment(6387b2f2-0bee-4573-8938-2efc29213a5f),segment_id=6387b2f2-0bee-4573-8938-2efc29213a5f)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:41.979530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9b70c9d6-2223-43b7-83de-57a219249145 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:42.349972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6703fe8-1cdb-4a85-a9ad-3829b503968e None None] Resource Port 3a245083-425c-44d7-b1c7-ff24d35e844e updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3a245083-425c-44d7-b1c7-ff24d35e844e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3a245083-425c-44d7-b1c7-ff24d35e844e,segment=NetworkSegment(dcee8df3-2008-4b96-bcaf-2c5a70d931e0),segment_id=dcee8df3-2008-4b96-bcaf-2c5a70d931e0)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3a245083-425c-44d7-b1c7-ff24d35e844e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:42.353885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6703fe8-1cdb-4a85-a9ad-3829b503968e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3a245083-425c-44d7-b1c7-ff24d35e844e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:42.818454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-80ab45be-2bcd-49c4-806b-e10c44ddc3f7 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:41Z,description='',direction='ingress',ethertype='IPv4',id=af5d9393-0fea-488a-9fba-d1ded2a6c25b,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d93458da-7a02-4d80-8695-660bb21543cd,updated_at=2022-10-16T00:57:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:42.819149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-80ab45be-2bcd-49c4-806b-e10c44ddc3f7 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (af5d9393-0fea-488a-9fba-d1ded2a6c25b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:42.819251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-80ab45be-2bcd-49c4-806b-e10c44ddc3f7 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 00:57:42.916740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd691164-c842-48e2-a2c5-7f3fea4e4c0b tempest-DeleteServersTestJSON-1247050903 tempest-DeleteServersTestJSON-1247050903-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:38Z,data_plane_status=None,description='',device_id='8a9b3320-e119-44b4-8035-2726ec9b56d4',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=67ec654d-ac07-4f60-a537-631325285925,mac_address=fa:16:3e:9d:71:a5,name='',network_id=987da718-4a64-4801-99fd-c8b997ad845b,numa_affinity_policy=,project_id='c89fd0e945344feab91a37fdb93812e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(67ec654d-ac07-4f60-a537-631325285925),security_group_ids=set([3fac4e82-9a4f-452d-92ae-7c5d7772b1b0]),status='DOWN',updated_at=2022-10-16T00:57:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:42.917199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd691164-c842-48e2-a2c5-7f3fea4e4c0b tempest-DeleteServersTestJSON-1247050903 tempest-DeleteServersTestJSON-1247050903-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (67ec654d-ac07-4f60-a537-631325285925), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:42.917672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd691164-c842-48e2-a2c5-7f3fea4e4c0b tempest-DeleteServersTestJSON-1247050903 tempest-DeleteServersTestJSON-1247050903-project] Security group member updated {'3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'} Oct 16 00:57:43.872625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d83c7d1b-19bf-45fd-911e-247a8ec07f05 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:42Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e,mac_address=fa:16:3e:e5:86:3a,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T00:57:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:43.873479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d83c7d1b-19bf-45fd-911e-247a8ec07f05 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.402559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:42Z,description='Default security group',id=9e67a34f-f584-4c62-83df-6e1353d457b2,is_default=True,name='default',project_id='e0fab4fb42b54a239f72b2696485c3b7',revision_number=1,rules=[SecurityGroupRule(24d2c4a2-a437-4617-bae3-5b1afb91c884),SecurityGroupRule(3fa55cef-4a08-4a0b-9562-7673c1dca7f1),SecurityGroupRule(a1386642-0714-4ce1-b819-aac055d36030),SecurityGroupRule(b026f1d0-a1bf-42f4-b6fd-419e41b057d0)],shared=False,stateful=True,updated_at=2022-10-16T00:57:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:44.403922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (9e67a34f-f584-4c62-83df-6e1353d457b2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.405482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:43Z,description=,direction='ingress',ethertype='IPv4',id=24d2c4a2-a437-4617-bae3-5b1afb91c884,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0fab4fb42b54a239f72b2696485c3b7',protocol=,remote_address_group_id=,remote_group_id=9e67a34f-f584-4c62-83df-6e1353d457b2,remote_ip_prefix=,revision_number=0,security_group_id=9e67a34f-f584-4c62-83df-6e1353d457b2,updated_at=2022-10-16T00:57:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:44.406327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (24d2c4a2-a437-4617-bae3-5b1afb91c884), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.406956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:44.407979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:43Z,description=,direction='egress',ethertype='IPv4',id=3fa55cef-4a08-4a0b-9562-7673c1dca7f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0fab4fb42b54a239f72b2696485c3b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e67a34f-f584-4c62-83df-6e1353d457b2,updated_at=2022-10-16T00:57:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:44.408642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3fa55cef-4a08-4a0b-9562-7673c1dca7f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.413896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:44.419776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:43Z,description=,direction='egress',ethertype='IPv6',id=a1386642-0714-4ce1-b819-aac055d36030,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0fab4fb42b54a239f72b2696485c3b7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e67a34f-f584-4c62-83df-6e1353d457b2,updated_at=2022-10-16T00:57:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:44.422392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a1386642-0714-4ce1-b819-aac055d36030), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.424708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:44.433532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:43Z,description=,direction='ingress',ethertype='IPv6',id=b026f1d0-a1bf-42f4-b6fd-419e41b057d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e0fab4fb42b54a239f72b2696485c3b7',protocol=,remote_address_group_id=,remote_group_id=9e67a34f-f584-4c62-83df-6e1353d457b2,remote_ip_prefix=,revision_number=0,security_group_id=9e67a34f-f584-4c62-83df-6e1353d457b2,updated_at=2022-10-16T00:57:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:44.434213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b026f1d0-a1bf-42f4-b6fd-419e41b057d0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.435508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79772f78-d62f-40ea-8ceb-a96c107c5432 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:44.502887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c8aeca6e-c891-420a-a971-aafd622e65ab","insert","qr-3a245083-42",["set",[]],["map",[["attached-mac","fa:16:3e:c1:95:0e"],["iface-id","3a245083-425c-44d7-b1c7-ff24d35e844e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:44.542403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c8aeca6e-c891-420a-a971-aafd622e65ab","old",null,["set",[]],null],["","new","qr-3a245083-42",16,["map",[["attached-mac","fa:16:3e:c1:95:0e"],["iface-id","3a245083-425c-44d7-b1c7-ff24d35e844e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:44.580317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27e8d476-f977-44aa-956f-612413b18ee7 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:43Z,description='',direction='ingress',ethertype='IPv4',id=68911359-5b95-49c8-bbf7-8be4f388653a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d93458da-7a02-4d80-8695-660bb21543cd,updated_at=2022-10-16T00:57:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:44.582276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27e8d476-f977-44aa-956f-612413b18ee7 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (68911359-5b95-49c8-bbf7-8be4f388653a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.584122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27e8d476-f977-44aa-956f-612413b18ee7 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 00:57:44.797300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 42633501-06b6-4c52-92d4-45822c5b414e updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=42633501-06b6-4c52-92d4-45822c5b414e,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=42633501-06b6-4c52-92d4-45822c5b414e,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:44.797701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (42633501-06b6-4c52-92d4-45822c5b414e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:44.814189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b571a249-640d-4cdf-bef6-81cea86b2c2a","insert","qr-d6c9e7b3-8f",["set",[]],["map",[["attached-mac","fa:16:3e:5c:27:e8"],["iface-id","d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:44.921646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b571a249-640d-4cdf-bef6-81cea86b2c2a","old",null,["set",[]],null],["","new","qr-d6c9e7b3-8f",17,["map",[["attached-mac","fa:16:3e:5c:27:e8"],["iface-id","d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:57:44.964009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['29057d15-832d-4bc1-939a-b77306acef22', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '42633501-06b6-4c52-92d4-45822c5b414e', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5'] and devices down [] completed. Oct 16 00:57:44.964351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:252 - ports processed. Elapsed:8.768 Oct 16 00:57:44.964700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 5, 'removed': 0}}. Elapsed:8.768 Oct 16 00:57:44.974709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Loop iteration exceeded interval (2 vs. 8.768033981323242)! {{(pid=105601) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 16 00:57:44.975048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:253 started Oct 16 00:57:44.989832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=624000000,duration_sec=531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:44.997420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:45.001901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:253 - starting polling. Elapsed:0.026 Oct 16 00:57:45.011575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:45.021146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:253 - port information retrieved. Elapsed:0.046 Oct 16 00:57:45.031985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', '831df3a8-d68b-40e9-b52b-297c2989e047', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '29057d15-832d-4bc1-939a-b77306acef22', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '92fd08e3-e2b0-40c2-b892-f442ec78a775', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': {'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '3a245083-425c-44d7-b1c7-ff24d35e844e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6'}, 'removed': set(), 'updated': {'42633501-06b6-4c52-92d4-45822c5b414e', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '3a245083-425c-44d7-b1c7-ff24d35e844e'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:45.035099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'mac_address': 'fa:16:3e:c8:27:1d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.225'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:45.035660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'mac_address': 'fa:16:3e:65:3e:2c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:45.038821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'mac_address': 'fa:16:3e:c1:95:0e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:45.039849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:30Z,data_plane_status=None,description='',device_id='04f2e7d9-6f59-4273-afb1-c6b961e608fe',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,mac_address=fa:16:3e:27:e4:1b,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(1243eb6a-8f6b-4732-b89b-091ec46b2b6d),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:57:34Z) is not bound. Oct 16 00:57:45.040427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'mac_address': 'fa:16:3e:5c:27:e8', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:45.041117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'mac_address': 'fa:16:3e:00:91:af', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.152'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:45.044988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '42633501-06b6-4c52-92d4-45822c5b414e', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '42633501-06b6-4c52-92d4-45822c5b414e', 'mac_address': 'fa:16:3e:1d:66:42', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.181'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:45.053387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: a74fd78f-a45f-4321-a4ca-57d2bcba43d1 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.059065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a74fd78f-a45f-4321-a4ca-57d2bcba43d1 updated. Details: {'device': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'mac_address': 'fa:16:3e:c8:27:1d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.225'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:45.068592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a74fd78f-a4, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.071045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a74fd78f-a4, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.073179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a74fd78f-a4, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.116644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a74fd78f-a4, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.174568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d2e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:45.175450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.176678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 updated. Details: {'device': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'mac_address': 'fa:16:3e:65:3e:2c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 16 00:57:45.179232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-edc13d5b-c9, col_values=(('tag', 4),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.180058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-edc13d5b-c9, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.180895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-edc13d5b-c9, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.224705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-edc13d5b-c9, col_values=(('other_config', {'net_uuid': '987da718-4a64-4801-99fd-c8b997ad845b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '363'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.271936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d30,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:45.273614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 3a245083-425c-44d7-b1c7-ff24d35e844e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.276671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3a245083-425c-44d7-b1c7-ff24d35e844e updated. Details: {'device': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'mac_address': 'fa:16:3e:c1:95:0e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 16 00:57:45.299038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3a245083-42, col_values=(('tag', 7),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.311278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3a245083-42, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.312206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3a245083-42, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.325497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3a245083-42, col_values=(('other_config', {'net_uuid': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '376'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.371121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d32,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:45.376092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 1243eb6a-8f6b-4732-b89b-091ec46b2b6d {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.379059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Device 1243eb6a-8f6b-4732-b89b-091ec46b2b6d not defined on plugin or binding failed Oct 16 00:57:45.382943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.383911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 updated. Details: {'device': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'mac_address': 'fa:16:3e:5c:27:e8', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 16 00:57:45.388557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6c9e7b3-8f, col_values=(('tag', 5),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.391441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d6c9e7b3-8f, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.392535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d6c9e7b3-8f, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.423698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6c9e7b3-8f, col_values=(('other_config', {'net_uuid': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '384'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.443376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d34,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:45.443800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.444155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 updated. Details: {'device': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', 'mac_address': 'fa:16:3e:00:91:af', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.152'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:45.448083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-71efdb3f-9c, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.450895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-71efdb3f-9c, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.451584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-71efdb3f-9c, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.453186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:45.458355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-71efdb3f-9c, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.462553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:45.466534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d36,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:45.467254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 42633501-06b6-4c52-92d4-45822c5b414e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:45.468627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 42633501-06b6-4c52-92d4-45822c5b414e updated. Details: {'device': '42633501-06b6-4c52-92d4-45822c5b414e', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '42633501-06b6-4c52-92d4-45822c5b414e', 'mac_address': 'fa:16:3e:1d:66:42', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.181'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:45.472451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-42633501-06, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.473511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-42633501-06, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.474658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-42633501-06, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.477497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:45.487031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-42633501-06, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:45.488183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:45.492999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d38,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:45.493488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:253 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.460 Oct 16 00:57:45.494102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 5 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:57:45.497530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', '3a245083-425c-44d7-b1c7-ff24d35e844e'} Oct 16 00:57:45.504461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:45.508930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:45.548121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:45.575045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d83c7d1b-19bf-45fd-911e-247a8ec07f05 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '63361ebc-ed62-43cf-a9e3-1ab87fe709d4'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:45.575723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d83c7d1b-19bf-45fd-911e-247a8ec07f05 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:45.738417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531a100-0c3c-46b6-9704-7ae9ed4efcd0]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:45.739110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 2 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:57:45.739424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:57:45.741163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:45.741458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:45.747096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:45.860802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[9accfda5-3fa0-4f97-9aef-624f45735605]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:45.872635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:253 - agent port security group processed in 0.838 Oct 16 00:57:45.873640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for a74fd78f-a45f-4321-a4ca-57d2bcba43d1 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:45.873931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:45.874230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 3a245083-425c-44d7-b1c7-ff24d35e844e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:45.874523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:45.874811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:45.875129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 42633501-06b6-4c52-92d4-45822c5b414e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:47.366940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port a74fd78f-a45f-4321-a4ca-57d2bcba43d1 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a74fd78f-a45f-4321-a4ca-57d2bcba43d1,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:47.367781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a74fd78f-a45f-4321-a4ca-57d2bcba43d1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:47.670442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Resource SecurityGroup deleted: 9e67a34f-f584-4c62-83df-6e1353d457b2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:47.670900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (9e67a34f-f584-4c62-83df-6e1353d457b2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:47.671831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9e67a34f-f584-4c62-83df-6e1353d457b2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:48.003324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9e67a34f-f584-4c62-83df-6e1353d457b2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:48.003987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Resource SecurityGroupRule deleted: 24d2c4a2-a437-4617-bae3-5b1afb91c884 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:48.005556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (24d2c4a2-a437-4617-bae3-5b1afb91c884), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:48.006318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:48.007188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Resource SecurityGroupRule deleted: 3fa55cef-4a08-4a0b-9562-7673c1dca7f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:48.007732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3fa55cef-4a08-4a0b-9562-7673c1dca7f1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:48.008381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:48.008921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Resource SecurityGroupRule deleted: a1386642-0714-4ce1-b819-aac055d36030 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:48.010287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a1386642-0714-4ce1-b819-aac055d36030), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:48.010950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:48.011534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Resource SecurityGroupRule deleted: b026f1d0-a1bf-42f4-b6fd-419e41b057d0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:48.012051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b026f1d0-a1bf-42f4-b6fd-419e41b057d0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:48.013060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4cebfe5c-6f57-4a7f-b5d9-c26332856f99 admin admin] Security group rule updated ['9e67a34f-f584-4c62-83df-6e1353d457b2'] Oct 16 00:57:49.646522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:48Z,description='Default security group',id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,is_default=True,name='default',project_id='64bd21611c864051a08b910c68d58539',revision_number=1,rules=[SecurityGroupRule(54e4a4f8-73f9-4f07-9b17-695d20889d49),SecurityGroupRule(b57e4270-97d0-45bf-87d9-3283d1deca8c),SecurityGroupRule(c8aaa9c0-0768-4461-8ada-bc2b5f37987b),SecurityGroupRule(edd5c81d-9d2a-472b-97d4-3faf21495a02)],shared=False,stateful=True,updated_at=2022-10-16T00:57:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:49.647718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3c48fee8-48d4-4e7d-b9b5-94496c802cbe), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:49.648526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:49Z,description=,direction='ingress',ethertype='IPv4',id=54e4a4f8-73f9-4f07-9b17-695d20889d49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='64bd21611c864051a08b910c68d58539',protocol=,remote_address_group_id=,remote_group_id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,remote_ip_prefix=,revision_number=0,security_group_id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,updated_at=2022-10-16T00:57:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:49.649109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (54e4a4f8-73f9-4f07-9b17-695d20889d49), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:49.649791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:49.650702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:49Z,description=,direction='egress',ethertype='IPv6',id=b57e4270-97d0-45bf-87d9-3283d1deca8c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='64bd21611c864051a08b910c68d58539',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,updated_at=2022-10-16T00:57:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:49.651297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b57e4270-97d0-45bf-87d9-3283d1deca8c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:49.651793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:49.652597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:49Z,description=,direction='egress',ethertype='IPv4',id=c8aaa9c0-0768-4461-8ada-bc2b5f37987b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='64bd21611c864051a08b910c68d58539',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,updated_at=2022-10-16T00:57:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:49.653691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c8aaa9c0-0768-4461-8ada-bc2b5f37987b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:49.654186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:49.657576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:49Z,description=,direction='ingress',ethertype='IPv6',id=edd5c81d-9d2a-472b-97d4-3faf21495a02,normalized_cidr=None,port_range_max=,port_range_min=,project_id='64bd21611c864051a08b910c68d58539',protocol=,remote_address_group_id=,remote_group_id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,remote_ip_prefix=,revision_number=0,security_group_id=3c48fee8-48d4-4e7d-b9b5-94496c802cbe,updated_at=2022-10-16T00:57:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:49.658145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (edd5c81d-9d2a-472b-97d4-3faf21495a02), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:49.658636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7371d11-7ee5-4d7b-92da-7db6e3f466b6 admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:49.685236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:49.688368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (edc13d5b-c9f2-4dc4-a392-0e617cb7cd97), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:49.729135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9980ebf3-2d98-4763-94b1-9e98acb4572e service neutron] Resource Port 67ec654d-ac07-4f60-a537-631325285925 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=67ec654d-ac07-4f60-a537-631325285925,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=67ec654d-ac07-4f60-a537-631325285925,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:49.729925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9980ebf3-2d98-4763-94b1-9e98acb4572e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (67ec654d-ac07-4f60-a537-631325285925), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:50.081837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1572e2cc-ec2c-4a0f-aace-7c9d60b7d07c tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:47Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0,mac_address=fa:16:3e:47:02:92,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T00:57:48Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:50.082292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1572e2cc-ec2c-4a0f-aace-7c9d60b7d07c tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:50.452763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a97578b-404c-48aa-af20-9d549290970f None None] Resource Port 1243eb6a-8f6b-4732-b89b-091ec46b2b6d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:50.453492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a97578b-404c-48aa-af20-9d549290970f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1243eb6a-8f6b-4732-b89b-091ec46b2b6d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:50.582328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e470f44-e938-4cef-b72b-05f49d7596cb tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:45Z,data_plane_status=None,description='',device_id='8d7ed11a-f7aa-4bed-bf41-596a5feb1c14',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=37a89ecc-65c3-483a-b753-8ddbd32b4132,mac_address=fa:16:3e:c5:64:ad,name='',network_id=f6d9aa56-b330-4b62-a416-c067206c96f0,numa_affinity_policy=,project_id='5462fcbfca114c8885f77f42b479b13d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(37a89ecc-65c3-483a-b753-8ddbd32b4132),security_group_ids=set([2373011f-2524-4861-b686-1d88cdba9ae8]),status='DOWN',updated_at=2022-10-16T00:57:47Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:50.584685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e470f44-e938-4cef-b72b-05f49d7596cb tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (37a89ecc-65c3-483a-b753-8ddbd32b4132), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:50.584685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6e470f44-e938-4cef-b72b-05f49d7596cb tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group member updated {'2373011f-2524-4861-b686-1d88cdba9ae8'} Oct 16 00:57:50.999871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Resource SecurityGroup deleted: 3c48fee8-48d4-4e7d-b9b5-94496c802cbe {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:51.000553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3c48fee8-48d4-4e7d-b9b5-94496c802cbe), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:51.001007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3c48fee8-48d4-4e7d-b9b5-94496c802cbe',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:51.080756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 3a245083-425c-44d7-b1c7-ff24d35e844e updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:51.081679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3a245083-425c-44d7-b1c7-ff24d35e844e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:51.130607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3c48fee8-48d4-4e7d-b9b5-94496c802cbe',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:51.136070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Resource SecurityGroupRule deleted: 54e4a4f8-73f9-4f07-9b17-695d20889d49 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:51.136070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (54e4a4f8-73f9-4f07-9b17-695d20889d49), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:51.136070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:51.136070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Resource SecurityGroupRule deleted: b57e4270-97d0-45bf-87d9-3283d1deca8c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:51.136070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b57e4270-97d0-45bf-87d9-3283d1deca8c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:51.136571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:51.141128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Resource SecurityGroupRule deleted: c8aaa9c0-0768-4461-8ada-bc2b5f37987b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:51.145266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c8aaa9c0-0768-4461-8ada-bc2b5f37987b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:51.148252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:51.150657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Resource SecurityGroupRule deleted: edd5c81d-9d2a-472b-97d4-3faf21495a02 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:51.152063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (edd5c81d-9d2a-472b-97d4-3faf21495a02), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:51.155483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7954f922-634a-4e1d-8bf9-32a90704be2e admin admin] Security group rule updated ['3c48fee8-48d4-4e7d-b9b5-94496c802cbe'] Oct 16 00:57:51.906403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a97578b-404c-48aa-af20-9d549290970f None None] Resource Port 1243eb6a-8f6b-4732-b89b-091ec46b2b6d updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,segment=NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565),segment_id=994bcd7f-d2ee-4126-bfcb-b7cd5780c565)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1243eb6a-8f6b-4732-b89b-091ec46b2b6d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:51.906796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a97578b-404c-48aa-af20-9d549290970f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1243eb6a-8f6b-4732-b89b-091ec46b2b6d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:52.321145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1d5eb9b8-135d-44f8-8a70-f7c87a39ed5c tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:49Z,data_plane_status=None,description='',device_id='b9dffef0-6081-49ec-9c9e-2412f35c0907',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e6727a07-61b9-4fef-83e4-902cce857bee,mac_address=fa:16:3e:cf:3b:34,name='',network_id=f6d9aa56-b330-4b62-a416-c067206c96f0,numa_affinity_policy=,project_id='5462fcbfca114c8885f77f42b479b13d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e6727a07-61b9-4fef-83e4-902cce857bee),security_group_ids=set([2373011f-2524-4861-b686-1d88cdba9ae8]),status='DOWN',updated_at=2022-10-16T00:57:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:52.321874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1d5eb9b8-135d-44f8-8a70-f7c87a39ed5c tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e6727a07-61b9-4fef-83e4-902cce857bee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:52.322969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1d5eb9b8-135d-44f8-8a70-f7c87a39ed5c tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group member updated {'2373011f-2524-4861-b686-1d88cdba9ae8'} Oct 16 00:57:53.036966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:53.037360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:53.782916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:53Z,description='Default security group',id=cebda2ee-f26d-45f1-aa28-e01544d43dca,is_default=True,name='default',project_id='1e231fb307c24d1897d19a612aaa1259',revision_number=1,rules=[SecurityGroupRule(0e7c4200-7ea4-4f09-ac9a-99404154f0ff),SecurityGroupRule(73ba9db7-e61d-4ce2-8682-09111ce67a98),SecurityGroupRule(7e275f0d-8ffc-4028-8436-6d41a3ff5aad),SecurityGroupRule(ee9abfe9-fc21-4ae9-8baf-7ae19744f376)],shared=False,stateful=True,updated_at=2022-10-16T00:57:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:53.785478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (cebda2ee-f26d-45f1-aa28-e01544d43dca), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:53.786760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:53Z,description=,direction='ingress',ethertype='IPv4',id=0e7c4200-7ea4-4f09-ac9a-99404154f0ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e231fb307c24d1897d19a612aaa1259',protocol=,remote_address_group_id=,remote_group_id=cebda2ee-f26d-45f1-aa28-e01544d43dca,remote_ip_prefix=,revision_number=0,security_group_id=cebda2ee-f26d-45f1-aa28-e01544d43dca,updated_at=2022-10-16T00:57:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:53.787518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0e7c4200-7ea4-4f09-ac9a-99404154f0ff), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:53.788130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:53.789261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:53Z,description=,direction='egress',ethertype='IPv4',id=73ba9db7-e61d-4ce2-8682-09111ce67a98,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e231fb307c24d1897d19a612aaa1259',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cebda2ee-f26d-45f1-aa28-e01544d43dca,updated_at=2022-10-16T00:57:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:53.789965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (73ba9db7-e61d-4ce2-8682-09111ce67a98), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:53.790585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:53.792373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:53Z,description=,direction='ingress',ethertype='IPv6',id=7e275f0d-8ffc-4028-8436-6d41a3ff5aad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e231fb307c24d1897d19a612aaa1259',protocol=,remote_address_group_id=,remote_group_id=cebda2ee-f26d-45f1-aa28-e01544d43dca,remote_ip_prefix=,revision_number=0,security_group_id=cebda2ee-f26d-45f1-aa28-e01544d43dca,updated_at=2022-10-16T00:57:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:53.795138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7e275f0d-8ffc-4028-8436-6d41a3ff5aad), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:53.796699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:53.797741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:53Z,description=,direction='egress',ethertype='IPv6',id=ee9abfe9-fc21-4ae9-8baf-7ae19744f376,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e231fb307c24d1897d19a612aaa1259',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cebda2ee-f26d-45f1-aa28-e01544d43dca,updated_at=2022-10-16T00:57:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:53.799357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ee9abfe9-fc21-4ae9-8baf-7ae19744f376), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:53.801906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b949d366-0509-494c-8336-1990b2cb1911 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:54.172964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1572e2cc-ec2c-4a0f-aace-7c9d60b7d07c tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource Port 5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '1bcd5911-464c-47c0-b764-2f44e2439a70'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:54.174353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1572e2cc-ec2c-4a0f-aace-7c9d60b7d07c tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:54.197969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', '3a245083-425c-44d7-b1c7-ff24d35e844e', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'] and devices down [] completed. Oct 16 00:57:54.198624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:253 - ports processed. Elapsed:9.223 Oct 16 00:57:54.199165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 5, 'updated': 4, 'removed': 0}}. Elapsed:9.224 Oct 16 00:57:54.200080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Loop iteration exceeded interval (2 vs. 9.224074602127075)! {{(pid=105601) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 16 00:57:54.200573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:254 started Oct 16 00:57:54.206113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=847000000,duration_sec=540,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:54.207105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:54.207818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.007 Oct 16 00:57:54.233875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:54.247949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.046 Oct 16 00:57:54.249237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', '831df3a8-d68b-40e9-b52b-297c2989e047', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': set(), 'updated': {'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', '3a245083-425c-44d7-b1c7-ff24d35e844e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:54.251721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'mac_address': 'fa:16:3e:27:e4:1b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:54.255280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'mac_address': 'fa:16:3e:5c:27:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:54.256903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'mac_address': 'fa:16:3e:65:3e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:54.258632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'mac_address': 'fa:16:3e:c8:27:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.225'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:54.261026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'mac_address': 'fa:16:3e:c1:95:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:54.271178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 1243eb6a-8f6b-4732-b89b-091ec46b2b6d {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:54.272964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1243eb6a-8f6b-4732-b89b-091ec46b2b6d updated. Details: {'device': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'mac_address': 'fa:16:3e:27:e4:1b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 16 00:57:54.276188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1243eb6a-8f, col_values=(('tag', 6),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.279403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1243eb6a-8f, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.280667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1243eb6a-8f, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.302284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1243eb6a-8f, col_values=(('other_config', {'net_uuid': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '354'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.334404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d3c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:54.337350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:54.338027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 updated. Details: {'device': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'device_id': '289771a6-e20d-4d10-9549-b95a58061b22', 'network_id': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'port_id': 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'mac_address': 'fa:16:3e:5c:27:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Oct 16 00:57:54.344826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6c9e7b3-8f, col_values=(('tag', 5),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.346595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d6c9e7b3-8f, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.348084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d6c9e7b3-8f, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.349825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.354038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6c9e7b3-8f, col_values=(('other_config', {'net_uuid': 'f6d9aa56-b330-4b62-a416-c067206c96f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '384', 'tag': '5'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.357198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.367210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d3e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:54.367560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:54.371365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 updated. Details: {'device': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'device_id': '0fe95cc5-8422-458f-b86c-c45f224fe276', 'network_id': '987da718-4a64-4801-99fd-c8b997ad845b', 'port_id': 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'mac_address': 'fa:16:3e:65:3e:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8fb2b922-74d5-4cae-b397-0d0c25d2079f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Oct 16 00:57:54.372918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-edc13d5b-c9, col_values=(('tag', 4),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.373547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-edc13d5b-c9, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.375619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-edc13d5b-c9, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.379259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.382242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-edc13d5b-c9, col_values=(('other_config', {'net_uuid': '987da718-4a64-4801-99fd-c8b997ad845b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '363', 'tag': '4'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.383847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.392945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d40,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:54.394105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: a74fd78f-a45f-4321-a4ca-57d2bcba43d1 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:54.394105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a74fd78f-a45f-4321-a4ca-57d2bcba43d1 updated. Details: {'device': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', 'mac_address': 'fa:16:3e:c8:27:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.225'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:57:54.395320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a74fd78f-a4, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.395990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a74fd78f-a4, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.402359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a74fd78f-a4, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.403725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.404817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a74fd78f-a4, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.410521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.428174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d42,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:54.428792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 3a245083-425c-44d7-b1c7-ff24d35e844e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:54.429974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3a245083-425c-44d7-b1c7-ff24d35e844e updated. Details: {'device': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'device_id': '66966500-9f64-45ff-98f6-e8d186878a55', 'network_id': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'port_id': '3a245083-425c-44d7-b1c7-ff24d35e844e', 'mac_address': 'fa:16:3e:c1:95:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 376, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Oct 16 00:57:54.432976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3a245083-42, col_values=(('tag', 7),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.434465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3a245083-42, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.437154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3a245083-42, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.438453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.445196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3a245083-42, col_values=(('other_config', {'net_uuid': '758abdbd-543f-42fe-8aa7-53af6cbbeb5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '376', 'tag': '7'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:54.446246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:54.454156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d44,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:54.459671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:254 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.209 Oct 16 00:57:54.461716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 5 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:57:54.462250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:57:54.477610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:54.480568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:54.494184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 10 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:54.631884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998012d-cf2d-4876-8e5d-6763c7ef8e55]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:54.632746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:254 - agent port security group processed in 0.383 Oct 16 00:57:54.633821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 1243eb6a-8f6b-4732-b89b-091ec46b2b6d to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:54.634206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:54.634598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:54.635003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for a74fd78f-a45f-4321-a4ca-57d2bcba43d1 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:54.635437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 3a245083-425c-44d7-b1c7-ff24d35e844e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:55.391580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:54Z,description='Default security group',id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,is_default=True,name='default',project_id='42941d5f4dae45c6b1cfa5a803a943d6',revision_number=1,rules=[SecurityGroupRule(7845ba07-a7e3-4a70-886f-63944ac2222b),SecurityGroupRule(c33ebed7-0a70-4ee2-8e39-3354f42221a4),SecurityGroupRule(eb142adf-407a-466d-96fd-7678c2805e9d),SecurityGroupRule(f3f92a3d-ee18-4529-90fd-70be5d385e2a)],shared=False,stateful=True,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.392298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (437cd40b-7478-4ab0-a4c9-f8967ae3b510), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.392691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='ingress',ethertype='IPv4',id=7845ba07-a7e3-4a70-886f-63944ac2222b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42941d5f4dae45c6b1cfa5a803a943d6',protocol=,remote_address_group_id=,remote_group_id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,remote_ip_prefix=,revision_number=0,security_group_id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.393056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7845ba07-a7e3-4a70-886f-63944ac2222b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.393403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:55.394081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='egress',ethertype='IPv4',id=c33ebed7-0a70-4ee2-8e39-3354f42221a4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42941d5f4dae45c6b1cfa5a803a943d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.394440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c33ebed7-0a70-4ee2-8e39-3354f42221a4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.394853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:55.395597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='ingress',ethertype='IPv6',id=eb142adf-407a-466d-96fd-7678c2805e9d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42941d5f4dae45c6b1cfa5a803a943d6',protocol=,remote_address_group_id=,remote_group_id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,remote_ip_prefix=,revision_number=0,security_group_id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.395948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (eb142adf-407a-466d-96fd-7678c2805e9d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.396328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:55.400568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='egress',ethertype='IPv6',id=f3f92a3d-ee18-4529-90fd-70be5d385e2a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42941d5f4dae45c6b1cfa5a803a943d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=437cd40b-7478-4ab0-a4c9-f8967ae3b510,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.402153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f3f92a3d-ee18-4529-90fd-70be5d385e2a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.404663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79db1395-8e65-42b6-a646-648f6969f052 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:55.546305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9980ebf3-2d98-4763-94b1-9e98acb4572e service neutron] Resource Port 67ec654d-ac07-4f60-a537-631325285925 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=67ec654d-ac07-4f60-a537-631325285925,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=67ec654d-ac07-4f60-a537-631325285925,segment=NetworkSegment(ebb1560a-1126-4b15-8db8-f323ab73a037),segment_id=ebb1560a-1126-4b15-8db8-f323ab73a037)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=67ec654d-ac07-4f60-a537-631325285925,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:55.546686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9980ebf3-2d98-4763-94b1-9e98acb4572e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (67ec654d-ac07-4f60-a537-631325285925), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.647606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:53Z,description='Default security group',id=e97de689-3f63-4d2c-847d-c5eff8bff130,is_default=True,name='default',project_id='ebf01e91c24e4380a3115bf63dda7bbd',revision_number=1,rules=[SecurityGroupRule(0498db6e-06bc-4c4f-a660-8810ee046353),SecurityGroupRule(41dc53ab-c5cf-4ed5-9201-f44471fb1fa1),SecurityGroupRule(ae7fe319-ea4a-4d3d-9830-54cbf5ff1314),SecurityGroupRule(fb364fee-8d6a-4758-b8f9-8bf94eae8b4d)],shared=False,stateful=True,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.647991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (e97de689-3f63-4d2c-847d-c5eff8bff130), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.648615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='egress',ethertype='IPv6',id=0498db6e-06bc-4c4f-a660-8810ee046353,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebf01e91c24e4380a3115bf63dda7bbd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e97de689-3f63-4d2c-847d-c5eff8bff130,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.649304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0498db6e-06bc-4c4f-a660-8810ee046353), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.649646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:55.650345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:53Z,description=,direction='ingress',ethertype='IPv4',id=41dc53ab-c5cf-4ed5-9201-f44471fb1fa1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebf01e91c24e4380a3115bf63dda7bbd',protocol=,remote_address_group_id=,remote_group_id=e97de689-3f63-4d2c-847d-c5eff8bff130,remote_ip_prefix=,revision_number=0,security_group_id=e97de689-3f63-4d2c-847d-c5eff8bff130,updated_at=2022-10-16T00:57:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.650701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (41dc53ab-c5cf-4ed5-9201-f44471fb1fa1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.651065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:55.651735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='ingress',ethertype='IPv6',id=ae7fe319-ea4a-4d3d-9830-54cbf5ff1314,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebf01e91c24e4380a3115bf63dda7bbd',protocol=,remote_address_group_id=,remote_group_id=e97de689-3f63-4d2c-847d-c5eff8bff130,remote_ip_prefix=,revision_number=0,security_group_id=e97de689-3f63-4d2c-847d-c5eff8bff130,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.652275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ae7fe319-ea4a-4d3d-9830-54cbf5ff1314), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.653446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:55.655372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:54Z,description=,direction='egress',ethertype='IPv4',id=fb364fee-8d6a-4758-b8f9-8bf94eae8b4d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebf01e91c24e4380a3115bf63dda7bbd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e97de689-3f63-4d2c-847d-c5eff8bff130,updated_at=2022-10-16T00:57:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:55.659506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fb364fee-8d6a-4758-b8f9-8bf94eae8b4d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.660017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a7094a7f-b093-437c-be14-e67534f121d8 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:55.685665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 1243eb6a-8f6b-4732-b89b-091ec46b2b6d updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:55.691507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1243eb6a-8f6b-4732-b89b-091ec46b2b6d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:55.924791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84b289f4-e093-47bc-ac86-5282c7264b46 service neutron] Resource Port 37a89ecc-65c3-483a-b753-8ddbd32b4132 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=37a89ecc-65c3-483a-b753-8ddbd32b4132,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=37a89ecc-65c3-483a-b753-8ddbd32b4132,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:55.926614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84b289f4-e093-47bc-ac86-5282c7264b46 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (37a89ecc-65c3-483a-b753-8ddbd32b4132), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.590632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Resource SecurityGroup deleted: cebda2ee-f26d-45f1-aa28-e01544d43dca {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.591407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (cebda2ee-f26d-45f1-aa28-e01544d43dca), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.613911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cebda2ee-f26d-45f1-aa28-e01544d43dca',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:56.617332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Resource SecurityGroup deleted: e97de689-3f63-4d2c-847d-c5eff8bff130 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.623021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (e97de689-3f63-4d2c-847d-c5eff8bff130), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.627258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e97de689-3f63-4d2c-847d-c5eff8bff130',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:56.673005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Resource SecurityGroup deleted: 437cd40b-7478-4ab0-a4c9-f8967ae3b510 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.675028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (437cd40b-7478-4ab0-a4c9-f8967ae3b510), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.675628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('437cd40b-7478-4ab0-a4c9-f8967ae3b510',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:56.693066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cebda2ee-f26d-45f1-aa28-e01544d43dca',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:56.694193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Resource SecurityGroupRule deleted: 0e7c4200-7ea4-4f09-ac9a-99404154f0ff {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.696162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0e7c4200-7ea4-4f09-ac9a-99404154f0ff), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.697817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:56.700292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Resource SecurityGroupRule deleted: 73ba9db7-e61d-4ce2-8682-09111ce67a98 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.700937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (73ba9db7-e61d-4ce2-8682-09111ce67a98), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.702479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:56.703854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Resource SecurityGroupRule deleted: 7e275f0d-8ffc-4028-8436-6d41a3ff5aad {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.705440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7e275f0d-8ffc-4028-8436-6d41a3ff5aad), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.705942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:56.707616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Resource SecurityGroupRule deleted: ee9abfe9-fc21-4ae9-8baf-7ae19744f376 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.708142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ee9abfe9-fc21-4ae9-8baf-7ae19744f376), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.709385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3e271107-79f8-4ea2-a50a-97faca942c20 admin admin] Security group rule updated ['cebda2ee-f26d-45f1-aa28-e01544d43dca'] Oct 16 00:57:56.723449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('437cd40b-7478-4ab0-a4c9-f8967ae3b510',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:56.726162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Resource SecurityGroupRule deleted: 7845ba07-a7e3-4a70-886f-63944ac2222b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.727761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7845ba07-a7e3-4a70-886f-63944ac2222b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.728181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:56.728595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Resource SecurityGroupRule deleted: c33ebed7-0a70-4ee2-8e39-3354f42221a4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.729739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c33ebed7-0a70-4ee2-8e39-3354f42221a4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.748807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:56.751610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Resource SecurityGroupRule deleted: eb142adf-407a-466d-96fd-7678c2805e9d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.752192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (eb142adf-407a-466d-96fd-7678c2805e9d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.754163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:56.754621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Resource SecurityGroupRule deleted: f3f92a3d-ee18-4529-90fd-70be5d385e2a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.755799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f3f92a3d-ee18-4529-90fd-70be5d385e2a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.756284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a691c970-e75e-4315-9430-1f6911fcab05 admin admin] Security group rule updated ['437cd40b-7478-4ab0-a4c9-f8967ae3b510'] Oct 16 00:57:56.788072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e97de689-3f63-4d2c-847d-c5eff8bff130',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:56.788744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Resource SecurityGroupRule deleted: 0498db6e-06bc-4c4f-a660-8810ee046353 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.790217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0498db6e-06bc-4c4f-a660-8810ee046353), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.790571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:56.791889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Resource SecurityGroupRule deleted: 41dc53ab-c5cf-4ed5-9201-f44471fb1fa1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.793223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (41dc53ab-c5cf-4ed5-9201-f44471fb1fa1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.795242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:56.795737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Resource SecurityGroupRule deleted: ae7fe319-ea4a-4d3d-9830-54cbf5ff1314 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.796111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ae7fe319-ea4a-4d3d-9830-54cbf5ff1314), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.797019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:56.798653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Resource SecurityGroupRule deleted: fb364fee-8d6a-4758-b8f9-8bf94eae8b4d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:56.799915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fb364fee-8d6a-4758-b8f9-8bf94eae8b4d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:56.800322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4a12a0b8-fa27-426c-882b-a6c516f941a9 admin admin] Security group rule updated ['e97de689-3f63-4d2c-847d-c5eff8bff130'] Oct 16 00:57:56.959032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84b289f4-e093-47bc-ac86-5282c7264b46 service neutron] Resource Port 37a89ecc-65c3-483a-b753-8ddbd32b4132 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=37a89ecc-65c3-483a-b753-8ddbd32b4132,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=37a89ecc-65c3-483a-b753-8ddbd32b4132,segment=NetworkSegment(6387b2f2-0bee-4573-8938-2efc29213a5f),segment_id=6387b2f2-0bee-4573-8938-2efc29213a5f)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=37a89ecc-65c3-483a-b753-8ddbd32b4132,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:56.960229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84b289f4-e093-47bc-ac86-5282c7264b46 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (37a89ecc-65c3-483a-b753-8ddbd32b4132), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.014197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '3a245083-425c-44d7-b1c7-ff24d35e844e'] and devices down [] completed. Oct 16 00:57:57.014536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:254 - ports processed. Elapsed:2.814 Oct 16 00:57:57.014933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 5, 'removed': 0}}. Elapsed:2.814 Oct 16 00:57:57.015676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Loop iteration exceeded interval (2 vs. 2.814485549926758)! {{(pid=105601) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Oct 16 00:57:57.016612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:255 started Oct 16 00:57:57.020373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=663000000,duration_sec=543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:57.020998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:57.021433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:255 - starting polling. Elapsed:0.005 Oct 16 00:57:57.027264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.036369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:255 - port information retrieved. Elapsed:0.020 Oct 16 00:57:57.037470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97', '831df3a8-d68b-40e9-b52b-297c2989e047', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': set(), 'updated': {'1243eb6a-8f6b-4732-b89b-091ec46b2b6d'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:57:57.039511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'mac_address': 'fa:16:3e:27:e4:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:57:57.050326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 1243eb6a-8f6b-4732-b89b-091ec46b2b6d {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:57:57.050704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1243eb6a-8f6b-4732-b89b-091ec46b2b6d updated. Details: {'device': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'device_id': '04f2e7d9-6f59-4273-afb1-c6b961e608fe', 'network_id': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'port_id': '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'mac_address': 'fa:16:3e:27:e4:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'a617817b-7e5e-42c9-b510-1f81c28bf50c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Oct 16 00:57:57.052024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1243eb6a-8f, col_values=(('tag', 6),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:57.052506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1243eb6a-8f, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:57.053027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1243eb6a-8f, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:57.053498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:57.064270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ae9b09d8-1d9b-40e3-a253-1e887a90e742 service neutron] Resource Port e6727a07-61b9-4fef-83e4-902cce857bee updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=e6727a07-61b9-4fef-83e4-902cce857bee,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e6727a07-61b9-4fef-83e4-902cce857bee,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:57.064441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ae9b09d8-1d9b-40e3-a253-1e887a90e742 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e6727a07-61b9-4fef-83e4-902cce857bee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.070280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1243eb6a-8f, col_values=(('other_config', {'net_uuid': '7dae3d76-90a2-41d2-9dad-7f7856d5ab85', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '354', 'tag': '6'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:57:57.073793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:57:57.081840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d48,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:57.084754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:255 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.044 Oct 16 00:57:57.086100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:57:57.086563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:57:57.092071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:57:57.092535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:57:57.104664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:57:57.169736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c36f259-b47d-47a5-a38b-a3a508439e58]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:57:57.170369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:255 - agent port security group processed in 0.133 Oct 16 00:57:57.171224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 1243eb6a-8f6b-4732-b89b-091ec46b2b6d to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:57:57.449307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['1243eb6a-8f6b-4732-b89b-091ec46b2b6d'] and devices down [] completed. Oct 16 00:57:57.450259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:255 - ports processed. Elapsed:0.434 Oct 16 00:57:57.451039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.435 Oct 16 00:57:57.668971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:57Z,description='Default security group',id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,is_default=True,name='default',project_id='7d45f968521b40bf8807ee060da82f1e',revision_number=1,rules=[SecurityGroupRule(42da2d93-e319-412b-9dd9-a0d2664145f1),SecurityGroupRule(56941f2d-f420-460b-bbfd-251e75dd8695),SecurityGroupRule(b1c8f7b6-0655-4519-b210-77b77fc757c3),SecurityGroupRule(d2e65496-5f78-4fd3-bf16-cd2cb19c6e87)],shared=False,stateful=True,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:57.670417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (bbac2212-6aa3-488b-8021-0c72e83e5a9a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.671662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='egress',ethertype='IPv4',id=42da2d93-e319-412b-9dd9-a0d2664145f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d45f968521b40bf8807ee060da82f1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:57.672311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (42da2d93-e319-412b-9dd9-a0d2664145f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.672947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:57.673927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='egress',ethertype='IPv6',id=56941f2d-f420-460b-bbfd-251e75dd8695,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d45f968521b40bf8807ee060da82f1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:57.674271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (56941f2d-f420-460b-bbfd-251e75dd8695), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.674619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:57.688397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='ingress',ethertype='IPv6',id=b1c8f7b6-0655-4519-b210-77b77fc757c3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d45f968521b40bf8807ee060da82f1e',protocol=,remote_address_group_id=,remote_group_id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,remote_ip_prefix=,revision_number=0,security_group_id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:57.689445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b1c8f7b6-0655-4519-b210-77b77fc757c3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.690027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:57.692448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='ingress',ethertype='IPv4',id=d2e65496-5f78-4fd3-bf16-cd2cb19c6e87,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7d45f968521b40bf8807ee060da82f1e',protocol=,remote_address_group_id=,remote_group_id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,remote_ip_prefix=,revision_number=0,security_group_id=bbac2212-6aa3-488b-8021-0c72e83e5a9a,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:57.693270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d2e65496-5f78-4fd3-bf16-cd2cb19c6e87), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:57.697279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f148179-a39f-4903-90c6-ac8d5d4ddfab admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:58.103792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bd6068f9-9453-4c25-a8cd-ebe44daa8e03 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:57:57Z,data_plane_status=None,description='',device_id='f0dbf503-273a-4834-af7e-20ee0ac8b573',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ae364987-4db0-45e9-8b32-48163c845492,mac_address=fa:16:3e:63:73:3c,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ae364987-4db0-45e9-8b32-48163c845492),security_group_ids=set([0aa46afa-7cf8-4516-97b1-1f6d9484df92]),status='DOWN',updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.103792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bd6068f9-9453-4c25-a8cd-ebe44daa8e03 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae364987-4db0-45e9-8b32-48163c845492), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.104138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bd6068f9-9453-4c25-a8cd-ebe44daa8e03 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'0aa46afa-7cf8-4516-97b1-1f6d9484df92'} Oct 16 00:57:58.326627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:57Z,description='Default security group',id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,is_default=True,name='default',project_id='8b9dcccdabca4bfba036e822ca020eff',revision_number=1,rules=[SecurityGroupRule(880b7d4c-f648-4858-a140-cf03c7033923),SecurityGroupRule(ccb2252d-9b77-45b4-a69a-6f216f2eb058),SecurityGroupRule(dbeeff40-824e-466a-859f-5a846d507afc),SecurityGroupRule(f47c52a2-6665-4802-a656-06e946da9bf6)],shared=False,stateful=True,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.327063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (cd2e3b36-e7f5-429b-9c42-b39693e2f1f6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.327695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='egress',ethertype='IPv4',id=880b7d4c-f648-4858-a140-cf03c7033923,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8b9dcccdabca4bfba036e822ca020eff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.328084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (880b7d4c-f648-4858-a140-cf03c7033923), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.328424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.329096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='ingress',ethertype='IPv4',id=ccb2252d-9b77-45b4-a69a-6f216f2eb058,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8b9dcccdabca4bfba036e822ca020eff',protocol=,remote_address_group_id=,remote_group_id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,remote_ip_prefix=,revision_number=0,security_group_id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.332530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ccb2252d-9b77-45b4-a69a-6f216f2eb058), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.332882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.333600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='egress',ethertype='IPv6',id=dbeeff40-824e-466a-859f-5a846d507afc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8b9dcccdabca4bfba036e822ca020eff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.342428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dbeeff40-824e-466a-859f-5a846d507afc), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.342781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.343566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='ingress',ethertype='IPv6',id=f47c52a2-6665-4802-a656-06e946da9bf6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8b9dcccdabca4bfba036e822ca020eff',protocol=,remote_address_group_id=,remote_group_id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,remote_ip_prefix=,revision_number=0,security_group_id=cd2e3b36-e7f5-429b-9c42-b39693e2f1f6,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.343929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f47c52a2-6665-4802-a656-06e946da9bf6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.344268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a24cc41d-3c12-41bd-b35a-607aa7d71a79 admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.493331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:58Z,description='Default security group',id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,is_default=True,name='default',project_id='692b78de7ff4450ab6d62431ad807c94',revision_number=1,rules=[SecurityGroupRule(12d3c8cd-0bf4-466e-9c2e-58186d9c7534),SecurityGroupRule(40071569-0bc9-40ab-af5e-9efbe1ce73af),SecurityGroupRule(73a7bf81-0432-45a9-9a20-84708a810a91),SecurityGroupRule(dc50fb97-1378-4d44-9b61-597363513174)],shared=False,stateful=True,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.497549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (c384771d-ad3b-4ca8-86b7-6f0635e15bdf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.502802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='egress',ethertype='IPv6',id=12d3c8cd-0bf4-466e-9c2e-58186d9c7534,normalized_cidr=None,port_range_max=,port_range_min=,project_id='692b78de7ff4450ab6d62431ad807c94',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.505631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (12d3c8cd-0bf4-466e-9c2e-58186d9c7534), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.506166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:58.507790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='egress',ethertype='IPv4',id=40071569-0bc9-40ab-af5e-9efbe1ce73af,normalized_cidr=None,port_range_max=,port_range_min=,project_id='692b78de7ff4450ab6d62431ad807c94',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.508544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (40071569-0bc9-40ab-af5e-9efbe1ce73af), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.509081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:58.510485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='ingress',ethertype='IPv6',id=73a7bf81-0432-45a9-9a20-84708a810a91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='692b78de7ff4450ab6d62431ad807c94',protocol=,remote_address_group_id=,remote_group_id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,remote_ip_prefix=,revision_number=0,security_group_id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.515076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (73a7bf81-0432-45a9-9a20-84708a810a91), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.515523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:58.516576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='ingress',ethertype='IPv4',id=dc50fb97-1378-4d44-9b61-597363513174,normalized_cidr=None,port_range_max=,port_range_min=,project_id='692b78de7ff4450ab6d62431ad807c94',protocol=,remote_address_group_id=,remote_group_id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,remote_ip_prefix=,revision_number=0,security_group_id=c384771d-ad3b-4ca8-86b7-6f0635e15bdf,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.517206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dc50fb97-1378-4d44-9b61-597363513174), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.517982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0a8f0cef-7cee-493b-8c3f-d2465f517f53 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:58.556621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ae9b09d8-1d9b-40e3-a253-1e887a90e742 service neutron] Resource Port e6727a07-61b9-4fef-83e4-902cce857bee updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e6727a07-61b9-4fef-83e4-902cce857bee,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e6727a07-61b9-4fef-83e4-902cce857bee,segment=NetworkSegment(6387b2f2-0bee-4573-8938-2efc29213a5f),segment_id=6387b2f2-0bee-4573-8938-2efc29213a5f)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e6727a07-61b9-4fef-83e4-902cce857bee,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:57:58.559806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ae9b09d8-1d9b-40e3-a253-1e887a90e742 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e6727a07-61b9-4fef-83e4-902cce857bee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.565357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Resource SecurityGroup deleted: bbac2212-6aa3-488b-8021-0c72e83e5a9a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.567139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (bbac2212-6aa3-488b-8021-0c72e83e5a9a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.567683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bbac2212-6aa3-488b-8021-0c72e83e5a9a',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:58.588472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bbac2212-6aa3-488b-8021-0c72e83e5a9a',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:58.590133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Resource SecurityGroupRule deleted: 42da2d93-e319-412b-9dd9-a0d2664145f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.591077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (42da2d93-e319-412b-9dd9-a0d2664145f1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.591596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:58.592403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Resource SecurityGroupRule deleted: 56941f2d-f420-460b-bbfd-251e75dd8695 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.592917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (56941f2d-f420-460b-bbfd-251e75dd8695), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.593382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:58.594065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Resource SecurityGroupRule deleted: b1c8f7b6-0655-4519-b210-77b77fc757c3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.594620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b1c8f7b6-0655-4519-b210-77b77fc757c3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.595110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:58.596242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Resource SecurityGroupRule deleted: d2e65496-5f78-4fd3-bf16-cd2cb19c6e87 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.596929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d2e65496-5f78-4fd3-bf16-cd2cb19c6e87), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.597650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0f0354a9-e9d2-45ce-ad84-a2b8c4092912 admin admin] Security group rule updated ['bbac2212-6aa3-488b-8021-0c72e83e5a9a'] Oct 16 00:57:58.682592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:57Z,description='Default security group',id=524c1362-ad26-4750-b1bc-6c125376edff,is_default=True,name='default',project_id='0d2920f753864a4c807705e2a33d0779',revision_number=1,rules=[SecurityGroupRule(5edef863-1d6c-4ce5-89fb-fcd06f055a09),SecurityGroupRule(6e0ea121-c80a-4a89-a01c-bbd637d5e220),SecurityGroupRule(d49a565e-bcc9-4312-befc-e402992ae926),SecurityGroupRule(de49ca83-b293-4717-ba9d-3b0d341327b8)],shared=False,stateful=True,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.684025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (524c1362-ad26-4750-b1bc-6c125376edff), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.685054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='egress',ethertype='IPv4',id=5edef863-1d6c-4ce5-89fb-fcd06f055a09,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d2920f753864a4c807705e2a33d0779',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=524c1362-ad26-4750-b1bc-6c125376edff,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.685720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5edef863-1d6c-4ce5-89fb-fcd06f055a09), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.686275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.687889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='egress',ethertype='IPv6',id=6e0ea121-c80a-4a89-a01c-bbd637d5e220,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d2920f753864a4c807705e2a33d0779',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=524c1362-ad26-4750-b1bc-6c125376edff,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.688686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6e0ea121-c80a-4a89-a01c-bbd637d5e220), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.689489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.690740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:58Z,description=,direction='ingress',ethertype='IPv6',id=d49a565e-bcc9-4312-befc-e402992ae926,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d2920f753864a4c807705e2a33d0779',protocol=,remote_address_group_id=,remote_group_id=524c1362-ad26-4750-b1bc-6c125376edff,remote_ip_prefix=,revision_number=0,security_group_id=524c1362-ad26-4750-b1bc-6c125376edff,updated_at=2022-10-16T00:57:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.692025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d49a565e-bcc9-4312-befc-e402992ae926), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.693032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.693996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:57Z,description=,direction='ingress',ethertype='IPv4',id=de49ca83-b293-4717-ba9d-3b0d341327b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d2920f753864a4c807705e2a33d0779',protocol=,remote_address_group_id=,remote_group_id=524c1362-ad26-4750-b1bc-6c125376edff,remote_ip_prefix=,revision_number=0,security_group_id=524c1362-ad26-4750-b1bc-6c125376edff,updated_at=2022-10-16T00:57:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:57:58.694625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (de49ca83-b293-4717-ba9d-3b0d341327b8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.695187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b10e2f84-2aa8-451c-90d5-929c282b2cbb admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.849867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Resource SecurityGroup deleted: 524c1362-ad26-4750-b1bc-6c125376edff {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.850254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (524c1362-ad26-4750-b1bc-6c125376edff), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.850771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('524c1362-ad26-4750-b1bc-6c125376edff',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:58.883928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('524c1362-ad26-4750-b1bc-6c125376edff',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:58.884485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Resource SecurityGroupRule deleted: 5edef863-1d6c-4ce5-89fb-fcd06f055a09 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.884955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5edef863-1d6c-4ce5-89fb-fcd06f055a09), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.891867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.893036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Resource SecurityGroupRule deleted: 6e0ea121-c80a-4a89-a01c-bbd637d5e220 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.897637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6e0ea121-c80a-4a89-a01c-bbd637d5e220), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.898957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.901437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Resource SecurityGroupRule deleted: d49a565e-bcc9-4312-befc-e402992ae926 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.902319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d49a565e-bcc9-4312-befc-e402992ae926), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.904944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.909328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Resource SecurityGroupRule deleted: de49ca83-b293-4717-ba9d-3b0d341327b8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.909788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (de49ca83-b293-4717-ba9d-3b0d341327b8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.910221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-add8f8bf-649a-4f75-baf0-ff6a8132ebfc admin admin] Security group rule updated ['524c1362-ad26-4750-b1bc-6c125376edff'] Oct 16 00:57:58.953283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Resource SecurityGroup deleted: cd2e3b36-e7f5-429b-9c42-b39693e2f1f6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.954130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (cd2e3b36-e7f5-429b-9c42-b39693e2f1f6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.959696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cd2e3b36-e7f5-429b-9c42-b39693e2f1f6',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:58.986047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cd2e3b36-e7f5-429b-9c42-b39693e2f1f6',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:58.986903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Resource SecurityGroupRule deleted: 880b7d4c-f648-4858-a140-cf03c7033923 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.987493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (880b7d4c-f648-4858-a140-cf03c7033923), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.988077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.988692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Resource SecurityGroupRule deleted: ccb2252d-9b77-45b4-a69a-6f216f2eb058 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.989797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ccb2252d-9b77-45b4-a69a-6f216f2eb058), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.990460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.991932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Resource SecurityGroupRule deleted: dbeeff40-824e-466a-859f-5a846d507afc {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.992499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dbeeff40-824e-466a-859f-5a846d507afc), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.993233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:58.994234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Resource SecurityGroupRule deleted: f47c52a2-6665-4802-a656-06e946da9bf6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:58.995161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f47c52a2-6665-4802-a656-06e946da9bf6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:58.995715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-73617ba6-59c9-4c3d-82a4-c4a714c1b83b admin admin] Security group rule updated ['cd2e3b36-e7f5-429b-9c42-b39693e2f1f6'] Oct 16 00:57:59.014607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Resource SecurityGroup deleted: c384771d-ad3b-4ca8-86b7-6f0635e15bdf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:59.015027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (c384771d-ad3b-4ca8-86b7-6f0635e15bdf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:59.015500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c384771d-ad3b-4ca8-86b7-6f0635e15bdf',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:57:59.018286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:256 started Oct 16 00:57:59.024800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=667000000,duration_sec=545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:57:59.025808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:57:59.026155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:256 - starting polling. Elapsed:0.008 Oct 16 00:57:59.034801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:59.041964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:256 - port information retrieved. Elapsed:0.022 Oct 16 00:57:59.042347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Oct 16 00:57:59.045092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c384771d-ad3b-4ca8-86b7-6f0635e15bdf',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:57:59.045627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Resource SecurityGroupRule deleted: 12d3c8cd-0bf4-466e-9c2e-58186d9c7534 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:59.046107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (12d3c8cd-0bf4-466e-9c2e-58186d9c7534), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:59.046430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:59.046933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Resource SecurityGroupRule deleted: 40071569-0bc9-40ab-af5e-9efbe1ce73af {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:59.047818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (40071569-0bc9-40ab-af5e-9efbe1ce73af), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:59.048313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:59.049040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Resource SecurityGroupRule deleted: 73a7bf81-0432-45a9-9a20-84708a810a91 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:59.052682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (73a7bf81-0432-45a9-9a20-84708a810a91), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:59.053071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:57:59.053481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Resource SecurityGroupRule deleted: dc50fb97-1378-4d44-9b61-597363513174 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:57:59.053848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dc50fb97-1378-4d44-9b61-597363513174), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:57:59.054182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e8bcccd-98db-4a4c-859f-e7e9ac1f47d7 admin admin] Security group rule updated ['c384771d-ad3b-4ca8-86b7-6f0635e15bdf'] Oct 16 00:58:00.484439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:57:59Z,description='Default security group',id=7b00de6e-00b7-40eb-853e-309c7941b50c,is_default=True,name='default',project_id='8540cf30cae44346aef35f64936213df',revision_number=1,rules=[SecurityGroupRule(59f97cdf-1f58-49f7-b5c9-a87460862ca4),SecurityGroupRule(b526030b-9840-4eed-a7a9-5c6a54f4dd28),SecurityGroupRule(c5c8186f-43e3-4f35-bdfc-706a1d0ef389),SecurityGroupRule(f4c71352-e181-4c20-8803-3af9635c2d3a)],shared=False,stateful=True,updated_at=2022-10-16T00:57:59Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:00.485109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (7b00de6e-00b7-40eb-853e-309c7941b50c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.485428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:59Z,description=,direction='ingress',ethertype='IPv6',id=59f97cdf-1f58-49f7-b5c9-a87460862ca4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8540cf30cae44346aef35f64936213df',protocol=,remote_address_group_id=,remote_group_id=7b00de6e-00b7-40eb-853e-309c7941b50c,remote_ip_prefix=,revision_number=0,security_group_id=7b00de6e-00b7-40eb-853e-309c7941b50c,updated_at=2022-10-16T00:57:59Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:00.485969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (59f97cdf-1f58-49f7-b5c9-a87460862ca4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.486447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.487284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:59Z,description=,direction='egress',ethertype='IPv6',id=b526030b-9840-4eed-a7a9-5c6a54f4dd28,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8540cf30cae44346aef35f64936213df',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b00de6e-00b7-40eb-853e-309c7941b50c,updated_at=2022-10-16T00:57:59Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:00.499578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b526030b-9840-4eed-a7a9-5c6a54f4dd28), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.501813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.503132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:59Z,description=,direction='ingress',ethertype='IPv4',id=c5c8186f-43e3-4f35-bdfc-706a1d0ef389,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8540cf30cae44346aef35f64936213df',protocol=,remote_address_group_id=,remote_group_id=7b00de6e-00b7-40eb-853e-309c7941b50c,remote_ip_prefix=,revision_number=0,security_group_id=7b00de6e-00b7-40eb-853e-309c7941b50c,updated_at=2022-10-16T00:57:59Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:00.505843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c5c8186f-43e3-4f35-bdfc-706a1d0ef389), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.515181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.515181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:57:59Z,description=,direction='egress',ethertype='IPv4',id=f4c71352-e181-4c20-8803-3af9635c2d3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8540cf30cae44346aef35f64936213df',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b00de6e-00b7-40eb-853e-309c7941b50c,updated_at=2022-10-16T00:57:59Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:00.515181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f4c71352-e181-4c20-8803-3af9635c2d3a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.527291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9ec9e3b9-7636-41b5-856e-78aa67ffe282 admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.829734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Resource SecurityGroup deleted: 7b00de6e-00b7-40eb-853e-309c7941b50c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:00.830117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (7b00de6e-00b7-40eb-853e-309c7941b50c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.830576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7b00de6e-00b7-40eb-853e-309c7941b50c',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:00.851382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7b00de6e-00b7-40eb-853e-309c7941b50c',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:00.852177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Resource SecurityGroupRule deleted: 59f97cdf-1f58-49f7-b5c9-a87460862ca4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:00.853121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (59f97cdf-1f58-49f7-b5c9-a87460862ca4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.853472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.853882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Resource SecurityGroupRule deleted: b526030b-9840-4eed-a7a9-5c6a54f4dd28 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:00.854374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b526030b-9840-4eed-a7a9-5c6a54f4dd28), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.854714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.855305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Resource SecurityGroupRule deleted: c5c8186f-43e3-4f35-bdfc-706a1d0ef389 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:00.855808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c5c8186f-43e3-4f35-bdfc-706a1d0ef389), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.856142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.856525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Resource SecurityGroupRule deleted: f4c71352-e181-4c20-8803-3af9635c2d3a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:00.856882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f4c71352-e181-4c20-8803-3af9635c2d3a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:00.857211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25b6afb5-cdec-4fe4-82a7-c1b060a4ba7e admin admin] Security group rule updated ['7b00de6e-00b7-40eb-853e-309c7941b50c'] Oct 16 00:58:00.923959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bc24dae1-2c69-4292-bd95-fd543f288cc5 service neutron] Resource Port ae364987-4db0-45e9-8b32-48163c845492 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=ae364987-4db0-45e9-8b32-48163c845492,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ae364987-4db0-45e9-8b32-48163c845492,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:00.924698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bc24dae1-2c69-4292-bd95-fd543f288cc5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae364987-4db0-45e9-8b32-48163c845492), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:01.019336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:257 started Oct 16 00:58:01.022183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=665000000,duration_sec=547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:01.022786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:01.023561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.005 Oct 16 00:58:01.025995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:01.033474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.011 Oct 16 00:58:01.033893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 00:58:01.253070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 67ec654d-ac07-4f60-a537-631325285925 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:01.253829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (67ec654d-ac07-4f60-a537-631325285925), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:01.515992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bc24dae1-2c69-4292-bd95-fd543f288cc5 service neutron] Resource Port ae364987-4db0-45e9-8b32-48163c845492 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ae364987-4db0-45e9-8b32-48163c845492,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=ae364987-4db0-45e9-8b32-48163c845492,segment=NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565),segment_id=994bcd7f-d2ee-4126-bfcb-b7cd5780c565)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ae364987-4db0-45e9-8b32-48163c845492,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:01.517607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bc24dae1-2c69-4292-bd95-fd543f288cc5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae364987-4db0-45e9-8b32-48163c845492), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:03.019620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:258 started Oct 16 00:58:03.024808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=666000000,duration_sec=549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:03.028094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:03.028636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:258 - starting polling. Elapsed:0.009 Oct 16 00:58:03.032925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:03.038443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:258 - port information retrieved. Elapsed:0.019 Oct 16 00:58:03.039557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 16 00:58:03.757383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 67ec654d-ac07-4f60-a537-631325285925 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:03.757771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (67ec654d-ac07-4f60-a537-631325285925), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:03.901751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 37a89ecc-65c3-483a-b753-8ddbd32b4132 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:03.902984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (37a89ecc-65c3-483a-b753-8ddbd32b4132), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.127541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port e6727a07-61b9-4fef-83e4-902cce857bee updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:04.128595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e6727a07-61b9-4fef-83e4-902cce857bee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.862554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:04Z,description='Default security group',id=4c32063d-f503-457a-ad08-be6b2a9d2647,is_default=True,name='default',project_id='56dafe1503724a8387b09e7ced1f22b6',revision_number=1,rules=[SecurityGroupRule(151cc9ef-0d80-499a-bfa3-6dca1679e689),SecurityGroupRule(3c697c80-9192-443d-b4fb-16c6e11d95bb),SecurityGroupRule(d6740d59-a5b8-414e-b5d2-882220caafcf),SecurityGroupRule(ff98854b-acd2-4067-acb9-e43cc728aca3)],shared=False,stateful=True,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.865995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (4c32063d-f503-457a-ad08-be6b2a9d2647), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.868666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='ingress',ethertype='IPv4',id=151cc9ef-0d80-499a-bfa3-6dca1679e689,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56dafe1503724a8387b09e7ced1f22b6',protocol=,remote_address_group_id=,remote_group_id=4c32063d-f503-457a-ad08-be6b2a9d2647,remote_ip_prefix=,revision_number=0,security_group_id=4c32063d-f503-457a-ad08-be6b2a9d2647,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.870485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (151cc9ef-0d80-499a-bfa3-6dca1679e689), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.871388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:04.874763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='egress',ethertype='IPv4',id=3c697c80-9192-443d-b4fb-16c6e11d95bb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56dafe1503724a8387b09e7ced1f22b6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4c32063d-f503-457a-ad08-be6b2a9d2647,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.875631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3c697c80-9192-443d-b4fb-16c6e11d95bb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.877544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:04.878785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='ingress',ethertype='IPv6',id=d6740d59-a5b8-414e-b5d2-882220caafcf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56dafe1503724a8387b09e7ced1f22b6',protocol=,remote_address_group_id=,remote_group_id=4c32063d-f503-457a-ad08-be6b2a9d2647,remote_ip_prefix=,revision_number=0,security_group_id=4c32063d-f503-457a-ad08-be6b2a9d2647,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.880750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d6740d59-a5b8-414e-b5d2-882220caafcf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.881338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:04.883197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='egress',ethertype='IPv6',id=ff98854b-acd2-4067-acb9-e43cc728aca3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56dafe1503724a8387b09e7ced1f22b6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4c32063d-f503-457a-ad08-be6b2a9d2647,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.884568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ff98854b-acd2-4067-acb9-e43cc728aca3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.885732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dd255c7-66fa-4b7f-8dd8-38f62156f741 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:04.977078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:04Z,description='Default security group',id=d442600b-298d-4344-a13b-61a47df53fa2,is_default=True,name='default',project_id='35ea763c74bf4281a2492556062f5b78',revision_number=1,rules=[SecurityGroupRule(4e4999c0-ac6b-4415-8def-1f0a7c6283b6),SecurityGroupRule(bfa63f2d-3dab-4090-b8a2-6fcaa1b9d000),SecurityGroupRule(d4084bff-f20b-428e-a161-4ec8b267fbf1),SecurityGroupRule(dce1c3eb-730f-447b-9bc7-0bbf2d8a91b3)],shared=False,stateful=True,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.977555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (d442600b-298d-4344-a13b-61a47df53fa2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.978324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='ingress',ethertype='IPv4',id=4e4999c0-ac6b-4415-8def-1f0a7c6283b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35ea763c74bf4281a2492556062f5b78',protocol=,remote_address_group_id=,remote_group_id=d442600b-298d-4344-a13b-61a47df53fa2,remote_ip_prefix=,revision_number=0,security_group_id=d442600b-298d-4344-a13b-61a47df53fa2,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.978803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4e4999c0-ac6b-4415-8def-1f0a7c6283b6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.979382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:04.980403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='egress',ethertype='IPv4',id=bfa63f2d-3dab-4090-b8a2-6fcaa1b9d000,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35ea763c74bf4281a2492556062f5b78',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d442600b-298d-4344-a13b-61a47df53fa2,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.981479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bfa63f2d-3dab-4090-b8a2-6fcaa1b9d000), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.982005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:04.983018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='egress',ethertype='IPv6',id=d4084bff-f20b-428e-a161-4ec8b267fbf1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35ea763c74bf4281a2492556062f5b78',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d442600b-298d-4344-a13b-61a47df53fa2,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.983583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d4084bff-f20b-428e-a161-4ec8b267fbf1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.984102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:04.985378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='ingress',ethertype='IPv6',id=dce1c3eb-730f-447b-9bc7-0bbf2d8a91b3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35ea763c74bf4281a2492556062f5b78',protocol=,remote_address_group_id=,remote_group_id=d442600b-298d-4344-a13b-61a47df53fa2,remote_ip_prefix=,revision_number=0,security_group_id=d442600b-298d-4344-a13b-61a47df53fa2,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:04.986357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dce1c3eb-730f-447b-9bc7-0bbf2d8a91b3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:04.986907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ea15d49d-61be-44c1-8a06-fba5052a87df admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:05.021189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:259 started Oct 16 00:58:05.024553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=667000000,duration_sec=551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:05.033828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:05.033828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:259 - starting polling. Elapsed:0.012 Oct 16 00:58:05.037810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.041414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:259 - port information retrieved. Elapsed:0.019 Oct 16 00:58:05.041782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Oct 16 00:58:05.070206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:04Z,description='Default security group',id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,is_default=True,name='default',project_id='8d819a5b4ad146bb8c3eccf8c8e2d7e9',revision_number=1,rules=[SecurityGroupRule(03a3f180-f900-4183-b235-af2b0fe24cbf),SecurityGroupRule(724acd6d-a810-4117-8ce9-50a7f995f50d),SecurityGroupRule(91edeb36-5b53-4617-96b5-e1f49227f62b),SecurityGroupRule(b3d60efc-15d3-4d13-832a-6e60f233160f)],shared=False,stateful=True,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.071415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (42bd8242-5229-4bb2-a4bc-db4a23dbde86), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.072287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='egress',ethertype='IPv6',id=03a3f180-f900-4183-b235-af2b0fe24cbf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d819a5b4ad146bb8c3eccf8c8e2d7e9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.074492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (03a3f180-f900-4183-b235-af2b0fe24cbf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.075043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.076703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='ingress',ethertype='IPv6',id=724acd6d-a810-4117-8ce9-50a7f995f50d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d819a5b4ad146bb8c3eccf8c8e2d7e9',protocol=,remote_address_group_id=,remote_group_id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,remote_ip_prefix=,revision_number=0,security_group_id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.077239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (724acd6d-a810-4117-8ce9-50a7f995f50d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.077743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.078674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='ingress',ethertype='IPv4',id=91edeb36-5b53-4617-96b5-e1f49227f62b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d819a5b4ad146bb8c3eccf8c8e2d7e9',protocol=,remote_address_group_id=,remote_group_id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,remote_ip_prefix=,revision_number=0,security_group_id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.079070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (91edeb36-5b53-4617-96b5-e1f49227f62b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.079400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.080743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:04Z,description=,direction='egress',ethertype='IPv4',id=b3d60efc-15d3-4d13-832a-6e60f233160f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d819a5b4ad146bb8c3eccf8c8e2d7e9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42bd8242-5229-4bb2-a4bc-db4a23dbde86,updated_at=2022-10-16T00:58:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.081340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b3d60efc-15d3-4d13-832a-6e60f233160f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.081729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf79a984-ae1b-4da3-aca3-d47362b08bcb admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.176980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Resource SecurityGroup deleted: d442600b-298d-4344-a13b-61a47df53fa2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.177525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (d442600b-298d-4344-a13b-61a47df53fa2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.177525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d442600b-298d-4344-a13b-61a47df53fa2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:05.203898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d442600b-298d-4344-a13b-61a47df53fa2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:05.204417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Resource SecurityGroupRule deleted: 4e4999c0-ac6b-4415-8def-1f0a7c6283b6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.204795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4e4999c0-ac6b-4415-8def-1f0a7c6283b6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.205131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:05.205561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Resource SecurityGroupRule deleted: bfa63f2d-3dab-4090-b8a2-6fcaa1b9d000 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.205968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bfa63f2d-3dab-4090-b8a2-6fcaa1b9d000), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.206516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:05.206654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Resource SecurityGroupRule deleted: d4084bff-f20b-428e-a161-4ec8b267fbf1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.207034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d4084bff-f20b-428e-a161-4ec8b267fbf1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.207353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:05.207839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Resource SecurityGroupRule deleted: dce1c3eb-730f-447b-9bc7-0bbf2d8a91b3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.208229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dce1c3eb-730f-447b-9bc7-0bbf2d8a91b3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.208551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8db04aba-f643-48e4-9f3a-f6a9a5becb1d admin admin] Security group rule updated ['d442600b-298d-4344-a13b-61a47df53fa2'] Oct 16 00:58:05.633421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Resource SecurityGroup deleted: 42bd8242-5229-4bb2-a4bc-db4a23dbde86 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.633811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (42bd8242-5229-4bb2-a4bc-db4a23dbde86), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.634284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('42bd8242-5229-4bb2-a4bc-db4a23dbde86',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:05.657029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('42bd8242-5229-4bb2-a4bc-db4a23dbde86',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:05.657505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Resource SecurityGroupRule deleted: 03a3f180-f900-4183-b235-af2b0fe24cbf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.658368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (03a3f180-f900-4183-b235-af2b0fe24cbf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.658775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.659158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Resource SecurityGroupRule deleted: 724acd6d-a810-4117-8ce9-50a7f995f50d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.660074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (724acd6d-a810-4117-8ce9-50a7f995f50d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.660413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.660794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Resource SecurityGroupRule deleted: 91edeb36-5b53-4617-96b5-e1f49227f62b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.663498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (91edeb36-5b53-4617-96b5-e1f49227f62b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.664292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.665483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Resource SecurityGroupRule deleted: b3d60efc-15d3-4d13-832a-6e60f233160f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.666132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b3d60efc-15d3-4d13-832a-6e60f233160f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.671448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ede125b-a12c-4cbe-a266-37a4d4acc2ab admin admin] Security group rule updated ['42bd8242-5229-4bb2-a4bc-db4a23dbde86'] Oct 16 00:58:05.683238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Resource SecurityGroup deleted: 4c32063d-f503-457a-ad08-be6b2a9d2647 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.686267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (4c32063d-f503-457a-ad08-be6b2a9d2647), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.686928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4c32063d-f503-457a-ad08-be6b2a9d2647',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:05.710542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4c32063d-f503-457a-ad08-be6b2a9d2647',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:05.711500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Resource SecurityGroupRule deleted: 151cc9ef-0d80-499a-bfa3-6dca1679e689 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.712978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (151cc9ef-0d80-499a-bfa3-6dca1679e689), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.716398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:05.719168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Resource SecurityGroupRule deleted: 3c697c80-9192-443d-b4fb-16c6e11d95bb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.720064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3c697c80-9192-443d-b4fb-16c6e11d95bb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.723702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:05.725119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Resource SecurityGroupRule deleted: d6740d59-a5b8-414e-b5d2-882220caafcf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.727026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d6740d59-a5b8-414e-b5d2-882220caafcf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.727660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:05.728346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Resource SecurityGroupRule deleted: ff98854b-acd2-4067-acb9-e43cc728aca3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:05.728969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ff98854b-acd2-4067-acb9-e43cc728aca3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.732851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-33283690-1c08-447a-bd93-ed58a875a190 admin admin] Security group rule updated ['4c32063d-f503-457a-ad08-be6b2a9d2647'] Oct 16 00:58:05.881694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:05Z,description='Default security group',id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,is_default=True,name='default',project_id='7deb2c3dae214df7895b40e7339bd6ea',revision_number=1,rules=[SecurityGroupRule(6dde3805-58fe-40ae-9c19-22f2e9dcb268),SecurityGroupRule(a318ea53-d486-4529-af16-5c19c6701843),SecurityGroupRule(c3f21492-ca3b-48d3-a834-4a9094b166f2),SecurityGroupRule(ddc6af6a-7144-4c24-a0b2-c09b030a0496)],shared=False,stateful=True,updated_at=2022-10-16T00:58:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.882658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.883625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:05Z,description=,direction='egress',ethertype='IPv4',id=6dde3805-58fe-40ae-9c19-22f2e9dcb268,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7deb2c3dae214df7895b40e7339bd6ea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,updated_at=2022-10-16T00:58:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.884365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6dde3805-58fe-40ae-9c19-22f2e9dcb268), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.884994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Security group rule updated ['a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d'] Oct 16 00:58:05.886121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:05Z,description=,direction='ingress',ethertype='IPv6',id=a318ea53-d486-4529-af16-5c19c6701843,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7deb2c3dae214df7895b40e7339bd6ea',protocol=,remote_address_group_id=,remote_group_id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,remote_ip_prefix=,revision_number=0,security_group_id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,updated_at=2022-10-16T00:58:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.887357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a318ea53-d486-4529-af16-5c19c6701843), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.888111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Security group rule updated ['a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d'] Oct 16 00:58:05.889329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:05Z,description=,direction='ingress',ethertype='IPv4',id=c3f21492-ca3b-48d3-a834-4a9094b166f2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7deb2c3dae214df7895b40e7339bd6ea',protocol=,remote_address_group_id=,remote_group_id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,remote_ip_prefix=,revision_number=0,security_group_id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,updated_at=2022-10-16T00:58:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.890155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c3f21492-ca3b-48d3-a834-4a9094b166f2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.891055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Security group rule updated ['a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d'] Oct 16 00:58:05.892339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:05Z,description=,direction='egress',ethertype='IPv6',id=ddc6af6a-7144-4c24-a0b2-c09b030a0496,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7deb2c3dae214df7895b40e7339bd6ea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d,updated_at=2022-10-16T00:58:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:05.893252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ddc6af6a-7144-4c24-a0b2-c09b030a0496), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:05.893920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd240776-210b-49ab-8119-dee181b2188e service neutron] Security group rule updated ['a1e7dd06-fc0d-4fce-b5ae-79dd9b08470d'] Oct 16 00:58:06.240958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:06Z,description='Default security group',id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,is_default=True,name='default',project_id='996d26fd06a943258239da182d539a21',revision_number=1,rules=[SecurityGroupRule(6e2305e0-8012-4b87-93de-d1fcad045619),SecurityGroupRule(c5e57a3c-6a3b-4755-b3c2-bc43d1ef619c),SecurityGroupRule(d6bb6570-c878-4807-9047-db2f1dfaddbe),SecurityGroupRule(e5a52d66-07cf-4af3-b77b-e3b11f382e6a)],shared=False,stateful=True,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.242191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (0de948cc-e4c1-4324-97a5-f07e9e6fc97a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.243514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='ingress',ethertype='IPv4',id=6e2305e0-8012-4b87-93de-d1fcad045619,normalized_cidr=None,port_range_max=,port_range_min=,project_id='996d26fd06a943258239da182d539a21',protocol=,remote_address_group_id=,remote_group_id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,remote_ip_prefix=,revision_number=0,security_group_id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.244108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6e2305e0-8012-4b87-93de-d1fcad045619), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.244677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.245756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='ingress',ethertype='IPv6',id=c5e57a3c-6a3b-4755-b3c2-bc43d1ef619c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='996d26fd06a943258239da182d539a21',protocol=,remote_address_group_id=,remote_group_id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,remote_ip_prefix=,revision_number=0,security_group_id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.247346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c5e57a3c-6a3b-4755-b3c2-bc43d1ef619c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.248020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.249507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='egress',ethertype='IPv6',id=d6bb6570-c878-4807-9047-db2f1dfaddbe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='996d26fd06a943258239da182d539a21',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.250572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d6bb6570-c878-4807-9047-db2f1dfaddbe), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.251179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.252088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='egress',ethertype='IPv4',id=e5a52d66-07cf-4af3-b77b-e3b11f382e6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='996d26fd06a943258239da182d539a21',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0de948cc-e4c1-4324-97a5-f07e9e6fc97a,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.252573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e5a52d66-07cf-4af3-b77b-e3b11f382e6a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.253119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf2c13-1c45-4994-95ee-cb480158949f admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.527222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0d064e1-e350-47e9-8ff5-302a695cbea6 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:58:04Z,data_plane_status=None,description='',device_id='d07b6833-a39f-462d-9c7e-48dda346d8cb',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9f15f027-a9c6-4298-a989-336905ee5a12,mac_address=fa:16:3e:61:a9:5a,name='',network_id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d,numa_affinity_policy=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9f15f027-a9c6-4298-a989-336905ee5a12),security_group_ids=set([d93458da-7a02-4d80-8695-660bb21543cd]),status='DOWN',updated_at=2022-10-16T00:58:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.530085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0d064e1-e350-47e9-8ff5-302a695cbea6 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.532942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0d064e1-e350-47e9-8ff5-302a695cbea6 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group member updated {'d93458da-7a02-4d80-8695-660bb21543cd'} Oct 16 00:58:06.701924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Resource SecurityGroup deleted: 0de948cc-e4c1-4324-97a5-f07e9e6fc97a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:06.702303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (0de948cc-e4c1-4324-97a5-f07e9e6fc97a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.703067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0de948cc-e4c1-4324-97a5-f07e9e6fc97a',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:06.718013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0de948cc-e4c1-4324-97a5-f07e9e6fc97a',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:06.718488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Resource SecurityGroupRule deleted: 6e2305e0-8012-4b87-93de-d1fcad045619 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:06.718883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6e2305e0-8012-4b87-93de-d1fcad045619), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.719217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.719622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Resource SecurityGroupRule deleted: c5e57a3c-6a3b-4755-b3c2-bc43d1ef619c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:06.719943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c5e57a3c-6a3b-4755-b3c2-bc43d1ef619c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.720264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.720634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Resource SecurityGroupRule deleted: d6bb6570-c878-4807-9047-db2f1dfaddbe {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:06.721244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d6bb6570-c878-4807-9047-db2f1dfaddbe), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.721653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.721920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Resource SecurityGroupRule deleted: e5a52d66-07cf-4af3-b77b-e3b11f382e6a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:06.722428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e5a52d66-07cf-4af3-b77b-e3b11f382e6a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.723204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4dafe2ec-18cc-4cac-86df-bbe81f89ef51 admin admin] Security group rule updated ['0de948cc-e4c1-4324-97a5-f07e9e6fc97a'] Oct 16 00:58:06.943854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:06Z,description='Default security group',id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,is_default=True,name='default',project_id='f88dc43c613e45aab8456768d988fb0c',revision_number=1,rules=[SecurityGroupRule(0ca5cd54-295c-4593-9de7-775c0b8ac06b),SecurityGroupRule(a6a7a89e-ee13-4434-b871-4117cdde89f0),SecurityGroupRule(da40d94a-2d25-4af2-ab77-a32ef5c5b100),SecurityGroupRule(e2ebef87-5302-4bb0-a764-c5c444f72bb4)],shared=False,stateful=True,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.944511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (10d50c51-f40d-4e3d-bcb1-c51ee7db9703), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.945448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='egress',ethertype='IPv4',id=0ca5cd54-295c-4593-9de7-775c0b8ac06b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f88dc43c613e45aab8456768d988fb0c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.945993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0ca5cd54-295c-4593-9de7-775c0b8ac06b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.946496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:06.947420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='egress',ethertype='IPv6',id=a6a7a89e-ee13-4434-b871-4117cdde89f0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f88dc43c613e45aab8456768d988fb0c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.947946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a6a7a89e-ee13-4434-b871-4117cdde89f0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.948291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:06.949033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='ingress',ethertype='IPv6',id=da40d94a-2d25-4af2-ab77-a32ef5c5b100,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f88dc43c613e45aab8456768d988fb0c',protocol=,remote_address_group_id=,remote_group_id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,remote_ip_prefix=,revision_number=0,security_group_id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.949441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (da40d94a-2d25-4af2-ab77-a32ef5c5b100), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.949781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:06.950450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:06Z,description=,direction='ingress',ethertype='IPv4',id=e2ebef87-5302-4bb0-a764-c5c444f72bb4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f88dc43c613e45aab8456768d988fb0c',protocol=,remote_address_group_id=,remote_group_id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,remote_ip_prefix=,revision_number=0,security_group_id=10d50c51-f40d-4e3d-bcb1-c51ee7db9703,updated_at=2022-10-16T00:58:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:06.953780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e2ebef87-5302-4bb0-a764-c5c444f72bb4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:06.954138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3a5310b7-4b01-4d15-834c-68da002a3965 admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:07.031305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:260 started Oct 16 00:58:07.031305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=668000000,duration_sec=553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:07.031305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:07.031305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:260 - starting polling. Elapsed:0.004 Oct 16 00:58:07.031752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.037414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:260 - port information retrieved. Elapsed:0.015 Oct 16 00:58:07.037819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 00:58:07.317379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:06Z,description='Default security group',id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,is_default=True,name='default',project_id='ab3e02221593480a8b183f9cb050dd38',revision_number=1,rules=[SecurityGroupRule(46999776-2361-4828-bd41-8b099b0d5c85),SecurityGroupRule(5e682b7c-7815-42ff-b738-016e8246939f),SecurityGroupRule(87149f71-a770-4770-be07-92237046c4d8),SecurityGroupRule(f4f1c2c1-9d4a-46ea-a197-68b65e5e5c3f)],shared=False,stateful=True,updated_at=2022-10-16T00:58:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:07.317935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3691881b-3472-49f0-aa10-5d3bc56ea4ae), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.318722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:07Z,description=,direction='egress',ethertype='IPv6',id=46999776-2361-4828-bd41-8b099b0d5c85,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab3e02221593480a8b183f9cb050dd38',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,updated_at=2022-10-16T00:58:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:07.319323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (46999776-2361-4828-bd41-8b099b0d5c85), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.319789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.320728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:07Z,description=,direction='ingress',ethertype='IPv4',id=5e682b7c-7815-42ff-b738-016e8246939f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab3e02221593480a8b183f9cb050dd38',protocol=,remote_address_group_id=,remote_group_id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,remote_ip_prefix=,revision_number=0,security_group_id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,updated_at=2022-10-16T00:58:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:07.321351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5e682b7c-7815-42ff-b738-016e8246939f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.322374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.322640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:07Z,description=,direction='ingress',ethertype='IPv6',id=87149f71-a770-4770-be07-92237046c4d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab3e02221593480a8b183f9cb050dd38',protocol=,remote_address_group_id=,remote_group_id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,remote_ip_prefix=,revision_number=0,security_group_id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,updated_at=2022-10-16T00:58:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:07.323091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (87149f71-a770-4770-be07-92237046c4d8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.325396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.327632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:07Z,description=,direction='egress',ethertype='IPv4',id=f4f1c2c1-9d4a-46ea-a197-68b65e5e5c3f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ab3e02221593480a8b183f9cb050dd38',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3691881b-3472-49f0-aa10-5d3bc56ea4ae,updated_at=2022-10-16T00:58:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:07.329866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f4f1c2c1-9d4a-46ea-a197-68b65e5e5c3f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.330694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8804b0d-c280-41e0-908d-507004603005 admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.507103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Resource SecurityGroup deleted: 10d50c51-f40d-4e3d-bcb1-c51ee7db9703 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.507757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (10d50c51-f40d-4e3d-bcb1-c51ee7db9703), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.508611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('10d50c51-f40d-4e3d-bcb1-c51ee7db9703',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:07.574562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 37a89ecc-65c3-483a-b753-8ddbd32b4132 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:07.575479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (37a89ecc-65c3-483a-b753-8ddbd32b4132), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.578706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('10d50c51-f40d-4e3d-bcb1-c51ee7db9703',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:07.580504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Resource SecurityGroupRule deleted: 0ca5cd54-295c-4593-9de7-775c0b8ac06b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.583300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0ca5cd54-295c-4593-9de7-775c0b8ac06b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.583300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:07.584101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Resource SecurityGroupRule deleted: a6a7a89e-ee13-4434-b871-4117cdde89f0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.584802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a6a7a89e-ee13-4434-b871-4117cdde89f0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.585170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:07.587786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Resource SecurityGroupRule deleted: da40d94a-2d25-4af2-ab77-a32ef5c5b100 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.589273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (da40d94a-2d25-4af2-ab77-a32ef5c5b100), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.590490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:07.593239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Resource SecurityGroupRule deleted: e2ebef87-5302-4bb0-a764-c5c444f72bb4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.593861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e2ebef87-5302-4bb0-a764-c5c444f72bb4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.595862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fcb5ccab-4812-4d34-b7bd-981cb86d9edb admin admin] Security group rule updated ['10d50c51-f40d-4e3d-bcb1-c51ee7db9703'] Oct 16 00:58:07.722135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Resource SecurityGroup deleted: 3691881b-3472-49f0-aa10-5d3bc56ea4ae {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.722681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3691881b-3472-49f0-aa10-5d3bc56ea4ae), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.723687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3691881b-3472-49f0-aa10-5d3bc56ea4ae',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:07.829857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port ae364987-4db0-45e9-8b32-48163c845492 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:07.830801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae364987-4db0-45e9-8b32-48163c845492), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.987456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3691881b-3472-49f0-aa10-5d3bc56ea4ae',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:07.988081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Resource SecurityGroupRule deleted: 46999776-2361-4828-bd41-8b099b0d5c85 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.988563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (46999776-2361-4828-bd41-8b099b0d5c85), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.989020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.989744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Resource SecurityGroupRule deleted: 5e682b7c-7815-42ff-b738-016e8246939f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.990184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5e682b7c-7815-42ff-b738-016e8246939f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.993324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.993913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Resource SecurityGroupRule deleted: 87149f71-a770-4770-be07-92237046c4d8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.994409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (87149f71-a770-4770-be07-92237046c4d8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.994855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:07.995508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Resource SecurityGroupRule deleted: f4f1c2c1-9d4a-46ea-a197-68b65e5e5c3f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:07.996464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f4f1c2c1-9d4a-46ea-a197-68b65e5e5c3f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:07.996957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-382b570e-9b78-418c-9e50-0a30d501c25d admin admin] Security group rule updated ['3691881b-3472-49f0-aa10-5d3bc56ea4ae'] Oct 16 00:58:08.374629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8bb1f82-4c51-4daa-a4c6-cd9ea3426359 service neutron] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=9f15f027-a9c6-4298-a989-336905ee5a12,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=9f15f027-a9c6-4298-a989-336905ee5a12,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:08.375324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8bb1f82-4c51-4daa-a4c6-cd9ea3426359 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:08.397516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port e6727a07-61b9-4fef-83e4-902cce857bee updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:08.397911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e6727a07-61b9-4fef-83e4-902cce857bee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:09.024505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:261 started Oct 16 00:58:09.034131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8bb1f82-4c51-4daa-a4c6-cd9ea3426359 service neutron] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=9f15f027-a9c6-4298-a989-336905ee5a12,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=9f15f027-a9c6-4298-a989-336905ee5a12,segment=NetworkSegment(dcee8df3-2008-4b96-bcaf-2c5a70d931e0),segment_id=dcee8df3-2008-4b96-bcaf-2c5a70d931e0)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=9f15f027-a9c6-4298-a989-336905ee5a12,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:09.034776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8bb1f82-4c51-4daa-a4c6-cd9ea3426359 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:09.041111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=682000000,duration_sec=555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:09.041706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:09.042052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:261 - starting polling. Elapsed:0.018 Oct 16 00:58:09.044726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:09.048766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:261 - port information retrieved. Elapsed:0.024 Oct 16 00:58:09.049404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.025 Oct 16 00:58:09.290308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port ae364987-4db0-45e9-8b32-48163c845492 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:09.290706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae364987-4db0-45e9-8b32-48163c845492), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:10.747952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:10Z,description='Default security group',id=52218b3c-54fc-499a-bfbd-25c31c268a13,is_default=True,name='default',project_id='a850973394834b1c9a2eb5370e303a21',revision_number=1,rules=[SecurityGroupRule(187b3f02-2ea8-43d2-80b9-acc746d1ab93),SecurityGroupRule(1ab0badf-a851-41d2-9bb5-ac93110e2890),SecurityGroupRule(b8f3f7e1-fbbf-4086-8e5b-b46782a7d793),SecurityGroupRule(f7bbe739-af69-4dde-aa91-dc35152321a6)],shared=False,stateful=True,updated_at=2022-10-16T00:58:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:10.749580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (52218b3c-54fc-499a-bfbd-25c31c268a13), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:10.751099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:10Z,description=,direction='ingress',ethertype='IPv6',id=187b3f02-2ea8-43d2-80b9-acc746d1ab93,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a850973394834b1c9a2eb5370e303a21',protocol=,remote_address_group_id=,remote_group_id=52218b3c-54fc-499a-bfbd-25c31c268a13,remote_ip_prefix=,revision_number=0,security_group_id=52218b3c-54fc-499a-bfbd-25c31c268a13,updated_at=2022-10-16T00:58:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:10.751965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (187b3f02-2ea8-43d2-80b9-acc746d1ab93), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:10.752720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:10.753651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:10Z,description=,direction='egress',ethertype='IPv4',id=1ab0badf-a851-41d2-9bb5-ac93110e2890,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a850973394834b1c9a2eb5370e303a21',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=52218b3c-54fc-499a-bfbd-25c31c268a13,updated_at=2022-10-16T00:58:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:10.754341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1ab0badf-a851-41d2-9bb5-ac93110e2890), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:10.754942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:10.756875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:10Z,description=,direction='ingress',ethertype='IPv4',id=b8f3f7e1-fbbf-4086-8e5b-b46782a7d793,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a850973394834b1c9a2eb5370e303a21',protocol=,remote_address_group_id=,remote_group_id=52218b3c-54fc-499a-bfbd-25c31c268a13,remote_ip_prefix=,revision_number=0,security_group_id=52218b3c-54fc-499a-bfbd-25c31c268a13,updated_at=2022-10-16T00:58:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:10.758198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b8f3f7e1-fbbf-4086-8e5b-b46782a7d793), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:10.760657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:10.761652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:10Z,description=,direction='egress',ethertype='IPv6',id=f7bbe739-af69-4dde-aa91-dc35152321a6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a850973394834b1c9a2eb5370e303a21',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=52218b3c-54fc-499a-bfbd-25c31c268a13,updated_at=2022-10-16T00:58:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:10.764129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f7bbe739-af69-4dde-aa91-dc35152321a6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:10.764756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:11.025425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:262 started Oct 16 00:58:11.029353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=672000000,duration_sec=557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:11.030236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:11.030721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:262 - starting polling. Elapsed:0.006 Oct 16 00:58:11.033155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:11.036562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:262 - port information retrieved. Elapsed:0.011 Oct 16 00:58:11.036924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 16 00:58:11.075797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:58:10Z,description='',dns_domain=None,id=60ed8060-2b52-472c-bd81-6d2d3a8ca986,mtu=1500,name='tempest-VolumesActionsTest-2068285255-network',project_id='a850973394834b1c9a2eb5370e303a21',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(60ed8060-2b52-472c-bd81-6d2d3a8ca986),segments=[NetworkSegment(b788703d-ad24-407a-9162-b4424ad7dd01)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:58:10Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:11.076696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (60ed8060-2b52-472c-bd81-6d2d3a8ca986), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-79bbea4e-53f8-464d-ae6c-d668d3eae070 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 60ed8060-2b52-472c-bd81-6d2d3a8ca986 with segmentation id not found. Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:58:11.218031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:58:11.219072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:58:11.219072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:58:11.219072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:58:11.219072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 60ed8060-2b52-472c-bd81-6d2d3a8ca986 with segmentation id not found. Oct 16 00:58:11.219072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:58:11.513051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9058782f-41b9-4901-b560-ca4320e49d96 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(d6cb21c6-ecbd-41ce-9b24-1c4e42777081)],cidr=172.20.0.0/28,created_at=2022-10-16T00:58:11Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=5e7c8763-28ee-4293-9560-4345d6255350,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-2068285255-subnet',network_id=60ed8060-2b52-472c-bd81-6d2d3a8ca986,project_id='a850973394834b1c9a2eb5370e303a21',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:58:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:11.513664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9058782f-41b9-4901-b560-ca4320e49d96 admin admin] Publish callbacks [] for Subnet (5e7c8763-28ee-4293-9560-4345d6255350), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:12.987331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:12Z,description='Default security group',id=68499fea-e4b3-426d-ad0a-b90a52f398f4,is_default=True,name='default',project_id='94e12a99f9f541e5a3b2b643ab0c0332',revision_number=1,rules=[SecurityGroupRule(15d8bcbc-caff-40f0-938b-427362715d86),SecurityGroupRule(333951a2-fb42-4f9f-b182-aa5d14d3fb3d),SecurityGroupRule(69a4c9b4-580d-449e-ae65-cf0049207bc5),SecurityGroupRule(af7bdae8-030e-4315-b027-3f3046b5e169)],shared=False,stateful=True,updated_at=2022-10-16T00:58:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:12.989194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (68499fea-e4b3-426d-ad0a-b90a52f398f4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:12.990686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:12Z,description=,direction='egress',ethertype='IPv4',id=15d8bcbc-caff-40f0-938b-427362715d86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94e12a99f9f541e5a3b2b643ab0c0332',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=68499fea-e4b3-426d-ad0a-b90a52f398f4,updated_at=2022-10-16T00:58:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:12.991419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (15d8bcbc-caff-40f0-938b-427362715d86), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:12.991928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:12.992770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:12Z,description=,direction='ingress',ethertype='IPv6',id=333951a2-fb42-4f9f-b182-aa5d14d3fb3d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94e12a99f9f541e5a3b2b643ab0c0332',protocol=,remote_address_group_id=,remote_group_id=68499fea-e4b3-426d-ad0a-b90a52f398f4,remote_ip_prefix=,revision_number=0,security_group_id=68499fea-e4b3-426d-ad0a-b90a52f398f4,updated_at=2022-10-16T00:58:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:12.993339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (333951a2-fb42-4f9f-b182-aa5d14d3fb3d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:12.993806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:12.994750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:12Z,description=,direction='egress',ethertype='IPv6',id=69a4c9b4-580d-449e-ae65-cf0049207bc5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94e12a99f9f541e5a3b2b643ab0c0332',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=68499fea-e4b3-426d-ad0a-b90a52f398f4,updated_at=2022-10-16T00:58:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:12.996472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (69a4c9b4-580d-449e-ae65-cf0049207bc5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:12.997056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:12.997960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:12Z,description=,direction='ingress',ethertype='IPv4',id=af7bdae8-030e-4315-b027-3f3046b5e169,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94e12a99f9f541e5a3b2b643ab0c0332',protocol=,remote_address_group_id=,remote_group_id=68499fea-e4b3-426d-ad0a-b90a52f398f4,remote_ip_prefix=,revision_number=0,security_group_id=68499fea-e4b3-426d-ad0a-b90a52f398f4,updated_at=2022-10-16T00:58:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:12.998483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (af7bdae8-030e-4315-b027-3f3046b5e169), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:12.999346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:13.028458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:263 started Oct 16 00:58:13.034039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=675000000,duration_sec=559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:13.036756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:13.037640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 00:58:13.156933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:58:12Z,description='',dns_domain=None,id=6d8a5b87-a2be-47de-b247-66876e428dd8,mtu=1500,name='tempest-VolumesActionsTest-1613045551-network',project_id='94e12a99f9f541e5a3b2b643ab0c0332',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(6d8a5b87-a2be-47de-b247-66876e428dd8),segments=[NetworkSegment(758f31d2-ed2a-4ced-b356-bb4cb1599b59)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:58:12Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:13.157445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (6d8a5b87-a2be-47de-b247-66876e428dd8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-2cf50fcb-8a73-45af-a7b3-6680d16a2ce3 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6d8a5b87-a2be-47de-b247-66876e428dd8 with segmentation id not found. Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:58:13.425280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:58:13.426242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:58:13.426242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:58:13.426242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:58:13.426242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6d8a5b87-a2be-47de-b247-66876e428dd8 with segmentation id not found. Oct 16 00:58:13.426242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:58:13.522929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:13.523567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:13.626359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b12ac43f-bd5a-4bf2-8a5c-62421b133ab9 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(2558adb2-63be-4323-acd6-b80ce468f408)],cidr=172.20.0.0/28,created_at=2022-10-16T00:58:13Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=ac4a82b5-ad59-4a60-aa54-b6fc731eff46,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1613045551-subnet',network_id=6d8a5b87-a2be-47de-b247-66876e428dd8,project_id='94e12a99f9f541e5a3b2b643ab0c0332',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:58:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:13.627578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b12ac43f-bd5a-4bf2-8a5c-62421b133ab9 admin admin] Publish callbacks [] for Subnet (ac4a82b5-ad59-4a60-aa54-b6fc731eff46), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.029808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:264 started Oct 16 00:58:15.033438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=676000000,duration_sec=561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:15.034565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:15.035138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:264 - starting polling. Elapsed:0.005 Oct 16 00:58:15.038145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.045959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:264 - port information retrieved. Elapsed:0.016 Oct 16 00:58:15.046321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 16 00:58:15.541288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:15.541921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.967814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:15Z,description='Default security group',id=a589a6c4-be87-436f-bb7e-07dec67867d1,is_default=True,name='default',project_id='e3a23c2edf614693949411584f0056b2',revision_number=1,rules=[SecurityGroupRule(124012ea-ce76-473c-9e91-fadb30555184),SecurityGroupRule(7cda4d9f-d3ad-4610-a0e6-1f8165981d50),SecurityGroupRule(d42bbf7c-bed4-44a6-9734-795bb94207b8),SecurityGroupRule(deecf902-d93e-4e9f-b1c1-af9bced1a715)],shared=False,stateful=True,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:15.968533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (a589a6c4-be87-436f-bb7e-07dec67867d1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.969366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='ingress',ethertype='IPv6',id=124012ea-ce76-473c-9e91-fadb30555184,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3a23c2edf614693949411584f0056b2',protocol=,remote_address_group_id=,remote_group_id=a589a6c4-be87-436f-bb7e-07dec67867d1,remote_ip_prefix=,revision_number=0,security_group_id=a589a6c4-be87-436f-bb7e-07dec67867d1,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:15.969952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (124012ea-ce76-473c-9e91-fadb30555184), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.970505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:15.971477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='ingress',ethertype='IPv4',id=7cda4d9f-d3ad-4610-a0e6-1f8165981d50,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3a23c2edf614693949411584f0056b2',protocol=,remote_address_group_id=,remote_group_id=a589a6c4-be87-436f-bb7e-07dec67867d1,remote_ip_prefix=,revision_number=0,security_group_id=a589a6c4-be87-436f-bb7e-07dec67867d1,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:15.972058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7cda4d9f-d3ad-4610-a0e6-1f8165981d50), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.972476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:15.974592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='egress',ethertype='IPv6',id=d42bbf7c-bed4-44a6-9734-795bb94207b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3a23c2edf614693949411584f0056b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a589a6c4-be87-436f-bb7e-07dec67867d1,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:15.974952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d42bbf7c-bed4-44a6-9734-795bb94207b8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.976357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:15.977484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='egress',ethertype='IPv4',id=deecf902-d93e-4e9f-b1c1-af9bced1a715,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e3a23c2edf614693949411584f0056b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a589a6c4-be87-436f-bb7e-07dec67867d1,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:15.978081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (deecf902-d93e-4e9f-b1c1-af9bced1a715), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:15.978541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dab72e13-b784-4035-8380-b367438fef15 admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:16.103093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:15Z,description='Default security group',id=3a211f47-0170-4129-8c64-12e2a14f1225,is_default=True,name='default',project_id='43a1557bbe394619a8e02760d2dc12d3',revision_number=1,rules=[SecurityGroupRule(1d914754-06d2-4ca8-b7c4-b16ccc4a8818),SecurityGroupRule(5962a995-fb81-4cac-82fe-76b978f9a313),SecurityGroupRule(bb2055c1-bec1-4456-84fe-7e8fdd28430b),SecurityGroupRule(f47ff134-3b86-4360-b84a-11428ce640f5)],shared=False,stateful=True,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:16.104263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3a211f47-0170-4129-8c64-12e2a14f1225), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:16.106394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='ingress',ethertype='IPv6',id=1d914754-06d2-4ca8-b7c4-b16ccc4a8818,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43a1557bbe394619a8e02760d2dc12d3',protocol=,remote_address_group_id=,remote_group_id=3a211f47-0170-4129-8c64-12e2a14f1225,remote_ip_prefix=,revision_number=0,security_group_id=3a211f47-0170-4129-8c64-12e2a14f1225,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:16.107339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1d914754-06d2-4ca8-b7c4-b16ccc4a8818), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:16.109322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:16.110687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='egress',ethertype='IPv4',id=5962a995-fb81-4cac-82fe-76b978f9a313,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43a1557bbe394619a8e02760d2dc12d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3a211f47-0170-4129-8c64-12e2a14f1225,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:16.111399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5962a995-fb81-4cac-82fe-76b978f9a313), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:16.111916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:16.113596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='ingress',ethertype='IPv4',id=bb2055c1-bec1-4456-84fe-7e8fdd28430b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43a1557bbe394619a8e02760d2dc12d3',protocol=,remote_address_group_id=,remote_group_id=3a211f47-0170-4129-8c64-12e2a14f1225,remote_ip_prefix=,revision_number=0,security_group_id=3a211f47-0170-4129-8c64-12e2a14f1225,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:16.114275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bb2055c1-bec1-4456-84fe-7e8fdd28430b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:16.114918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:16.116111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:15Z,description=,direction='egress',ethertype='IPv6',id=f47ff134-3b86-4360-b84a-11428ce640f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='43a1557bbe394619a8e02760d2dc12d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3a211f47-0170-4129-8c64-12e2a14f1225,updated_at=2022-10-16T00:58:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:16.116554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f47ff134-3b86-4360-b84a-11428ce640f5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:16.118232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7bcacbb-b20e-4466-9287-f68193b92c6c admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:16.924975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Resource SecurityGroup deleted: 3a211f47-0170-4129-8c64-12e2a14f1225 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:16.926351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3a211f47-0170-4129-8c64-12e2a14f1225), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:16.928180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3a211f47-0170-4129-8c64-12e2a14f1225',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:16.997692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Resource SecurityGroup deleted: a589a6c4-be87-436f-bb7e-07dec67867d1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:16.998571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (a589a6c4-be87-436f-bb7e-07dec67867d1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.000121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a589a6c4-be87-436f-bb7e-07dec67867d1',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:17.004274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3a211f47-0170-4129-8c64-12e2a14f1225',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:17.008033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Resource SecurityGroupRule deleted: 1d914754-06d2-4ca8-b7c4-b16ccc4a8818 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.013633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1d914754-06d2-4ca8-b7c4-b16ccc4a8818), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.014268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:17.014838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Resource SecurityGroupRule deleted: 5962a995-fb81-4cac-82fe-76b978f9a313 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.015384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5962a995-fb81-4cac-82fe-76b978f9a313), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.016823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:17.017754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Resource SecurityGroupRule deleted: bb2055c1-bec1-4456-84fe-7e8fdd28430b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.018757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bb2055c1-bec1-4456-84fe-7e8fdd28430b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.019286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:17.021181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Resource SecurityGroupRule deleted: f47ff134-3b86-4360-b84a-11428ce640f5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.021756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f47ff134-3b86-4360-b84a-11428ce640f5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.022458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e36c1ba-5a92-46ad-856c-468566f85cc2 admin admin] Security group rule updated ['3a211f47-0170-4129-8c64-12e2a14f1225'] Oct 16 00:58:17.034503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:265 started Oct 16 00:58:17.043610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=681000000,duration_sec=563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:17.046042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:17.048261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:265 - starting polling. Elapsed:0.014 Oct 16 00:58:17.051360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.054638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:265 - port information retrieved. Elapsed:0.020 Oct 16 00:58:17.055895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Oct 16 00:58:17.058135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a589a6c4-be87-436f-bb7e-07dec67867d1',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:17.059122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Resource SecurityGroupRule deleted: 124012ea-ce76-473c-9e91-fadb30555184 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.059922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (124012ea-ce76-473c-9e91-fadb30555184), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.060427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:17.060999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Resource SecurityGroupRule deleted: 7cda4d9f-d3ad-4610-a0e6-1f8165981d50 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.061514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7cda4d9f-d3ad-4610-a0e6-1f8165981d50), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.062165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:17.062693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Resource SecurityGroupRule deleted: d42bbf7c-bed4-44a6-9734-795bb94207b8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.063409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d42bbf7c-bed4-44a6-9734-795bb94207b8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.063745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:17.064219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Resource SecurityGroupRule deleted: deecf902-d93e-4e9f-b1c1-af9bced1a715 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:17.064583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (deecf902-d93e-4e9f-b1c1-af9bced1a715), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:17.064969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88bd5cd4-7610-46da-8b6a-a1a2540d08dd admin admin] Security group rule updated ['a589a6c4-be87-436f-bb7e-07dec67867d1'] Oct 16 00:58:18.067978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:17Z,description='Default security group',id=da700cc3-1c99-4ec7-b39d-d044e4582a76,is_default=True,name='default',project_id='e44d58ff3c704162be8230616968b2d6',revision_number=1,rules=[SecurityGroupRule(2c3514d4-62ae-4ba4-95a6-98d9980937f7),SecurityGroupRule(37eac6fd-df68-4270-95d6-a785788f7648),SecurityGroupRule(41e44786-8864-4345-926d-e9b39cb7d24a),SecurityGroupRule(61f68665-504c-4b6f-81d6-781dcf98928f)],shared=False,stateful=True,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.068566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (da700cc3-1c99-4ec7-b39d-d044e4582a76), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.069118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='egress',ethertype='IPv6',id=2c3514d4-62ae-4ba4-95a6-98d9980937f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e44d58ff3c704162be8230616968b2d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=da700cc3-1c99-4ec7-b39d-d044e4582a76,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.069633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2c3514d4-62ae-4ba4-95a6-98d9980937f7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.070096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.070950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='ingress',ethertype='IPv4',id=37eac6fd-df68-4270-95d6-a785788f7648,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e44d58ff3c704162be8230616968b2d6',protocol=,remote_address_group_id=,remote_group_id=da700cc3-1c99-4ec7-b39d-d044e4582a76,remote_ip_prefix=,revision_number=0,security_group_id=da700cc3-1c99-4ec7-b39d-d044e4582a76,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.072227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (37eac6fd-df68-4270-95d6-a785788f7648), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.072589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.073290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='egress',ethertype='IPv4',id=41e44786-8864-4345-926d-e9b39cb7d24a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e44d58ff3c704162be8230616968b2d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=da700cc3-1c99-4ec7-b39d-d044e4582a76,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.074192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (41e44786-8864-4345-926d-e9b39cb7d24a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.074578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.075410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='ingress',ethertype='IPv6',id=61f68665-504c-4b6f-81d6-781dcf98928f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e44d58ff3c704162be8230616968b2d6',protocol=,remote_address_group_id=,remote_group_id=da700cc3-1c99-4ec7-b39d-d044e4582a76,remote_ip_prefix=,revision_number=0,security_group_id=da700cc3-1c99-4ec7-b39d-d044e4582a76,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.079674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (61f68665-504c-4b6f-81d6-781dcf98928f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.080240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-567d201b-0c15-4a36-be45-ded18f7623d1 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.102909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:17Z,description='Default security group',id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,is_default=True,name='default',project_id='75b4f48624b84658bf50d2c95e001e3a',revision_number=1,rules=[SecurityGroupRule(43d9ec2c-d6e6-4256-b075-831b145094da),SecurityGroupRule(97f22756-b549-43a1-a68f-52a1a98d73a5),SecurityGroupRule(a8fb951d-40c7-4895-8340-36f09baa923d),SecurityGroupRule(edabb243-78e7-482e-9cc7-97fb0a9de483)],shared=False,stateful=True,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.103612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (48b59524-9638-4d7d-b7fd-01c3040c4a1f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.104437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='ingress',ethertype='IPv4',id=43d9ec2c-d6e6-4256-b075-831b145094da,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75b4f48624b84658bf50d2c95e001e3a',protocol=,remote_address_group_id=,remote_group_id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,remote_ip_prefix=,revision_number=0,security_group_id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.105551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (43d9ec2c-d6e6-4256-b075-831b145094da), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.106553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.108191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='ingress',ethertype='IPv6',id=97f22756-b549-43a1-a68f-52a1a98d73a5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75b4f48624b84658bf50d2c95e001e3a',protocol=,remote_address_group_id=,remote_group_id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,remote_ip_prefix=,revision_number=0,security_group_id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.109101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (97f22756-b549-43a1-a68f-52a1a98d73a5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.109870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.114361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='egress',ethertype='IPv6',id=a8fb951d-40c7-4895-8340-36f09baa923d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75b4f48624b84658bf50d2c95e001e3a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.115707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a8fb951d-40c7-4895-8340-36f09baa923d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.119937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.122511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:17Z,description=,direction='egress',ethertype='IPv4',id=edabb243-78e7-482e-9cc7-97fb0a9de483,normalized_cidr=None,port_range_max=,port_range_min=,project_id='75b4f48624b84658bf50d2c95e001e3a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=48b59524-9638-4d7d-b7fd-01c3040c4a1f,updated_at=2022-10-16T00:58:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:18.123352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (edabb243-78e7-482e-9cc7-97fb0a9de483), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.124040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b56e437a-d3af-4a92-9c63-172547f2a808 admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.462475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Resource SecurityGroup deleted: da700cc3-1c99-4ec7-b39d-d044e4582a76 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.462891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (da700cc3-1c99-4ec7-b39d-d044e4582a76), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.465319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('da700cc3-1c99-4ec7-b39d-d044e4582a76',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:18.480700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('da700cc3-1c99-4ec7-b39d-d044e4582a76',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:18.481728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Resource SecurityGroupRule deleted: 2c3514d4-62ae-4ba4-95a6-98d9980937f7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.483202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2c3514d4-62ae-4ba4-95a6-98d9980937f7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.483797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.484699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Resource SecurityGroupRule deleted: 37eac6fd-df68-4270-95d6-a785788f7648 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.485417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (37eac6fd-df68-4270-95d6-a785788f7648), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.486093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.486701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Resource SecurityGroupRule deleted: 41e44786-8864-4345-926d-e9b39cb7d24a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.487727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (41e44786-8864-4345-926d-e9b39cb7d24a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.488305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.488895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Resource SecurityGroupRule deleted: 61f68665-504c-4b6f-81d6-781dcf98928f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.490048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (61f68665-504c-4b6f-81d6-781dcf98928f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.490761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f7eadad-8d0f-451b-a174-8a28a69be1c5 admin admin] Security group rule updated ['da700cc3-1c99-4ec7-b39d-d044e4582a76'] Oct 16 00:58:18.500022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Resource SecurityGroup deleted: 48b59524-9638-4d7d-b7fd-01c3040c4a1f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.500702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (48b59524-9638-4d7d-b7fd-01c3040c4a1f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.501536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('48b59524-9638-4d7d-b7fd-01c3040c4a1f',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:18.524266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('48b59524-9638-4d7d-b7fd-01c3040c4a1f',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:18.525163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Resource SecurityGroupRule deleted: 43d9ec2c-d6e6-4256-b075-831b145094da {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.525748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (43d9ec2c-d6e6-4256-b075-831b145094da), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.526283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.527334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Resource SecurityGroupRule deleted: 97f22756-b549-43a1-a68f-52a1a98d73a5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.528093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (97f22756-b549-43a1-a68f-52a1a98d73a5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.528790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.529496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Resource SecurityGroupRule deleted: a8fb951d-40c7-4895-8340-36f09baa923d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.530077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a8fb951d-40c7-4895-8340-36f09baa923d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.530814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:18.531440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Resource SecurityGroupRule deleted: edabb243-78e7-482e-9cc7-97fb0a9de483 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:18.533015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (edabb243-78e7-482e-9cc7-97fb0a9de483), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:18.533593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-60c382f1-3aed-46c1-b00a-f92d490ab0ef admin admin] Security group rule updated ['48b59524-9638-4d7d-b7fd-01c3040c4a1f'] Oct 16 00:58:19.037728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:266 started Oct 16 00:58:19.048365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=689000000,duration_sec=565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:19.051647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:19.053002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 00:58:19.869746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:19Z,description='Default security group',id=6dc43857-0f82-40fc-83a6-94d655a7b561,is_default=True,name='default',project_id='69722a0b3c1440de98c6e392d1b120c7',revision_number=1,rules=[SecurityGroupRule(42f5162b-bf95-4f1d-8dbf-d7dba4cc1f1e),SecurityGroupRule(4fa7c72d-b2c7-473a-b925-e68593137f5a),SecurityGroupRule(9cd00056-05f1-4452-adb6-cf14f6bc6166),SecurityGroupRule(c83a5485-8b1e-4ebc-9ed6-96b578620c13)],shared=False,stateful=True,updated_at=2022-10-16T00:58:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:19.870531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (6dc43857-0f82-40fc-83a6-94d655a7b561), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:19.870811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:19Z,description=,direction='egress',ethertype='IPv6',id=42f5162b-bf95-4f1d-8dbf-d7dba4cc1f1e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69722a0b3c1440de98c6e392d1b120c7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6dc43857-0f82-40fc-83a6-94d655a7b561,updated_at=2022-10-16T00:58:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:19.871204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (42f5162b-bf95-4f1d-8dbf-d7dba4cc1f1e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:19.871549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:19.872243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:19Z,description=,direction='ingress',ethertype='IPv6',id=4fa7c72d-b2c7-473a-b925-e68593137f5a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69722a0b3c1440de98c6e392d1b120c7',protocol=,remote_address_group_id=,remote_group_id=6dc43857-0f82-40fc-83a6-94d655a7b561,remote_ip_prefix=,revision_number=0,security_group_id=6dc43857-0f82-40fc-83a6-94d655a7b561,updated_at=2022-10-16T00:58:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:19.872602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4fa7c72d-b2c7-473a-b925-e68593137f5a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:19.873080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:19.873880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:19Z,description=,direction='egress',ethertype='IPv4',id=9cd00056-05f1-4452-adb6-cf14f6bc6166,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69722a0b3c1440de98c6e392d1b120c7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6dc43857-0f82-40fc-83a6-94d655a7b561,updated_at=2022-10-16T00:58:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:19.874271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9cd00056-05f1-4452-adb6-cf14f6bc6166), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:19.874607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:19.875308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:19Z,description=,direction='ingress',ethertype='IPv4',id=c83a5485-8b1e-4ebc-9ed6-96b578620c13,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69722a0b3c1440de98c6e392d1b120c7',protocol=,remote_address_group_id=,remote_group_id=6dc43857-0f82-40fc-83a6-94d655a7b561,remote_ip_prefix=,revision_number=0,security_group_id=6dc43857-0f82-40fc-83a6-94d655a7b561,updated_at=2022-10-16T00:58:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:19.875666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c83a5485-8b1e-4ebc-9ed6-96b578620c13), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:19.875997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fd1ca3aa-989d-43b1-8301-21d561678140 admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:20.131728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Resource SecurityGroup deleted: 6dc43857-0f82-40fc-83a6-94d655a7b561 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:20.132123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (6dc43857-0f82-40fc-83a6-94d655a7b561), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:20.132575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6dc43857-0f82-40fc-83a6-94d655a7b561',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:20.145984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6dc43857-0f82-40fc-83a6-94d655a7b561',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:20.146852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Resource SecurityGroupRule deleted: 42f5162b-bf95-4f1d-8dbf-d7dba4cc1f1e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:20.147527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (42f5162b-bf95-4f1d-8dbf-d7dba4cc1f1e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:20.148206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:20.148541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Resource SecurityGroupRule deleted: 4fa7c72d-b2c7-473a-b925-e68593137f5a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:20.149182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4fa7c72d-b2c7-473a-b925-e68593137f5a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:20.149699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:20.150515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Resource SecurityGroupRule deleted: 9cd00056-05f1-4452-adb6-cf14f6bc6166 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:20.150991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9cd00056-05f1-4452-adb6-cf14f6bc6166), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:20.151565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:20.152705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Resource SecurityGroupRule deleted: c83a5485-8b1e-4ebc-9ed6-96b578620c13 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:20.153214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c83a5485-8b1e-4ebc-9ed6-96b578620c13), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:20.153696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6d4a94e6-7da2-42d1-9749-09415408d2cb admin admin] Security group rule updated ['6dc43857-0f82-40fc-83a6-94d655a7b561'] Oct 16 00:58:21.039345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:267 started Oct 16 00:58:21.042291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=685000000,duration_sec=567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:21.042970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:21.043510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:58:21.098311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:20Z,description='Default security group',id=b2438771-1457-4886-a6cf-152c6c00c176,is_default=True,name='default',project_id='039a813f1de5494cbd44cc85ede9fbf8',revision_number=1,rules=[SecurityGroupRule(7c784785-5faf-4040-a734-2f703f4bb0be),SecurityGroupRule(b3fd458c-91a0-47d6-81ed-c3fab3acf50f),SecurityGroupRule(ccc4bc0e-d992-4480-a0f1-49a794545571),SecurityGroupRule(eb10187a-8af6-4359-8cce-20393ee5b872)],shared=False,stateful=True,updated_at=2022-10-16T00:58:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:21.099014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (b2438771-1457-4886-a6cf-152c6c00c176), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.099836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:21Z,description=,direction='egress',ethertype='IPv6',id=7c784785-5faf-4040-a734-2f703f4bb0be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='039a813f1de5494cbd44cc85ede9fbf8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b2438771-1457-4886-a6cf-152c6c00c176,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:21.103785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7c784785-5faf-4040-a734-2f703f4bb0be), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.104431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.105966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:20Z,description=,direction='egress',ethertype='IPv4',id=b3fd458c-91a0-47d6-81ed-c3fab3acf50f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='039a813f1de5494cbd44cc85ede9fbf8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b2438771-1457-4886-a6cf-152c6c00c176,updated_at=2022-10-16T00:58:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:21.106549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b3fd458c-91a0-47d6-81ed-c3fab3acf50f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.107113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.108122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:20Z,description=,direction='ingress',ethertype='IPv4',id=ccc4bc0e-d992-4480-a0f1-49a794545571,normalized_cidr=None,port_range_max=,port_range_min=,project_id='039a813f1de5494cbd44cc85ede9fbf8',protocol=,remote_address_group_id=,remote_group_id=b2438771-1457-4886-a6cf-152c6c00c176,remote_ip_prefix=,revision_number=0,security_group_id=b2438771-1457-4886-a6cf-152c6c00c176,updated_at=2022-10-16T00:58:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:21.108404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ccc4bc0e-d992-4480-a0f1-49a794545571), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.108679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.109398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:21Z,description=,direction='ingress',ethertype='IPv6',id=eb10187a-8af6-4359-8cce-20393ee5b872,normalized_cidr=None,port_range_max=,port_range_min=,project_id='039a813f1de5494cbd44cc85ede9fbf8',protocol=,remote_address_group_id=,remote_group_id=b2438771-1457-4886-a6cf-152c6c00c176,remote_ip_prefix=,revision_number=0,security_group_id=b2438771-1457-4886-a6cf-152c6c00c176,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:21.109763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (eb10187a-8af6-4359-8cce-20393ee5b872), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.110188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bd83a06b-7978-485f-b3ac-2c0f71f305e8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.344057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Resource SecurityGroup deleted: b2438771-1457-4886-a6cf-152c6c00c176 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:21.344453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (b2438771-1457-4886-a6cf-152c6c00c176), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.345003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b2438771-1457-4886-a6cf-152c6c00c176',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:21.370685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b2438771-1457-4886-a6cf-152c6c00c176',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:21.371402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Resource SecurityGroupRule deleted: 7c784785-5faf-4040-a734-2f703f4bb0be {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:21.372062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7c784785-5faf-4040-a734-2f703f4bb0be), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.372451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.373200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Resource SecurityGroupRule deleted: b3fd458c-91a0-47d6-81ed-c3fab3acf50f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:21.374233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b3fd458c-91a0-47d6-81ed-c3fab3acf50f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.374946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.375490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Resource SecurityGroupRule deleted: ccc4bc0e-d992-4480-a0f1-49a794545571 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:21.375870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ccc4bc0e-d992-4480-a0f1-49a794545571), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.377377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:21.377682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Resource SecurityGroupRule deleted: eb10187a-8af6-4359-8cce-20393ee5b872 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:21.378199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (eb10187a-8af6-4359-8cce-20393ee5b872), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:21.378745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1ec3bece-4bc5-4120-b4c1-cc7b07de00d8 admin admin] Security group rule updated ['b2438771-1457-4886-a6cf-152c6c00c176'] Oct 16 00:58:22.027087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:21Z,description='Default security group',id=88469409-5730-4138-9548-8dced4084593,is_default=True,name='default',project_id='978a7bd015b148ff81040c266cdcf551',revision_number=1,rules=[SecurityGroupRule(0739bf67-7731-49fd-9d50-bc862c4f7171),SecurityGroupRule(088050f3-6e67-4171-9eb3-93ea5e5ce172),SecurityGroupRule(1f0a23ac-c7c3-487f-8d79-73dbe4461eee),SecurityGroupRule(f6ced059-9697-47e7-a47d-1be31bab3d3f)],shared=False,stateful=True,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:22.027966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (88469409-5730-4138-9548-8dced4084593), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.028654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:21Z,description=,direction='ingress',ethertype='IPv4',id=0739bf67-7731-49fd-9d50-bc862c4f7171,normalized_cidr=None,port_range_max=,port_range_min=,project_id='978a7bd015b148ff81040c266cdcf551',protocol=,remote_address_group_id=,remote_group_id=88469409-5730-4138-9548-8dced4084593,remote_ip_prefix=,revision_number=0,security_group_id=88469409-5730-4138-9548-8dced4084593,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:22.029035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0739bf67-7731-49fd-9d50-bc862c4f7171), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.029386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.030081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:21Z,description=,direction='egress',ethertype='IPv4',id=088050f3-6e67-4171-9eb3-93ea5e5ce172,normalized_cidr=None,port_range_max=,port_range_min=,project_id='978a7bd015b148ff81040c266cdcf551',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=88469409-5730-4138-9548-8dced4084593,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:22.030586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (088050f3-6e67-4171-9eb3-93ea5e5ce172), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.030954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.031628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:21Z,description=,direction='egress',ethertype='IPv6',id=1f0a23ac-c7c3-487f-8d79-73dbe4461eee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='978a7bd015b148ff81040c266cdcf551',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=88469409-5730-4138-9548-8dced4084593,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:22.031994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1f0a23ac-c7c3-487f-8d79-73dbe4461eee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.032331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.033009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:21Z,description=,direction='ingress',ethertype='IPv6',id=f6ced059-9697-47e7-a47d-1be31bab3d3f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='978a7bd015b148ff81040c266cdcf551',protocol=,remote_address_group_id=,remote_group_id=88469409-5730-4138-9548-8dced4084593,remote_ip_prefix=,revision_number=0,security_group_id=88469409-5730-4138-9548-8dced4084593,updated_at=2022-10-16T00:58:21Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:22.033380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f6ced059-9697-47e7-a47d-1be31bab3d3f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.033709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb3763-d775-4fbe-8b76-8b460d5cdb94 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.266782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Resource SecurityGroup deleted: 88469409-5730-4138-9548-8dced4084593 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:22.267528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (88469409-5730-4138-9548-8dced4084593), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.267961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('88469409-5730-4138-9548-8dced4084593',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:22.288928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('88469409-5730-4138-9548-8dced4084593',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:22.290116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Resource SecurityGroupRule deleted: 0739bf67-7731-49fd-9d50-bc862c4f7171 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:22.290834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0739bf67-7731-49fd-9d50-bc862c4f7171), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.291419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.292740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Resource SecurityGroupRule deleted: 088050f3-6e67-4171-9eb3-93ea5e5ce172 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:22.293809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (088050f3-6e67-4171-9eb3-93ea5e5ce172), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.294656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.295280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Resource SecurityGroupRule deleted: 1f0a23ac-c7c3-487f-8d79-73dbe4461eee {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:22.295883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1f0a23ac-c7c3-487f-8d79-73dbe4461eee), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.296452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:22.297001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Resource SecurityGroupRule deleted: f6ced059-9697-47e7-a47d-1be31bab3d3f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:22.297530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f6ced059-9697-47e7-a47d-1be31bab3d3f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:22.298241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09c182f3-5d04-46e7-9a49-a0de9e6727f5 admin admin] Security group rule updated ['88469409-5730-4138-9548-8dced4084593'] Oct 16 00:58:23.040285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:268 started Oct 16 00:58:23.044869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=686000000,duration_sec=569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:23.045472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:23.045840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:58:25.041204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:269 started Oct 16 00:58:25.047076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=687000000,duration_sec=571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:25.048080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:25.048441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:58:27.042831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:270 started Oct 16 00:58:27.045363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=688000000,duration_sec=573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:27.045932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:27.046285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:58:29.043406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:271 started Oct 16 00:58:29.048643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=689000000,duration_sec=575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:29.048643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:29.048643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:58:31.045005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:272 started Oct 16 00:58:31.047899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=691000000,duration_sec=577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:31.048788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:31.049390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:58:31.093513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:30Z,description='Default security group',id=01165a5f-2892-45d5-a617-be5ac6807d5a,is_default=True,name='default',project_id='39d1c20705604f8794fb441271e5afd3',revision_number=1,rules=[SecurityGroupRule(1157ee42-7008-45f0-b15a-2402ebb73b05),SecurityGroupRule(38519ed2-4a30-472e-a699-0888b833a9fd),SecurityGroupRule(dda03b7b-543b-4ea5-8d74-b599c70626a0),SecurityGroupRule(efa2436c-a3ed-4ff2-acad-4001f95a9e67)],shared=False,stateful=True,updated_at=2022-10-16T00:58:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:31.093835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (01165a5f-2892-45d5-a617-be5ac6807d5a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.094754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:30Z,description=,direction='ingress',ethertype='IPv6',id=1157ee42-7008-45f0-b15a-2402ebb73b05,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39d1c20705604f8794fb441271e5afd3',protocol=,remote_address_group_id=,remote_group_id=01165a5f-2892-45d5-a617-be5ac6807d5a,remote_ip_prefix=,revision_number=0,security_group_id=01165a5f-2892-45d5-a617-be5ac6807d5a,updated_at=2022-10-16T00:58:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:31.095264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1157ee42-7008-45f0-b15a-2402ebb73b05), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.095694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:31.096608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:30Z,description=,direction='egress',ethertype='IPv6',id=38519ed2-4a30-472e-a699-0888b833a9fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39d1c20705604f8794fb441271e5afd3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01165a5f-2892-45d5-a617-be5ac6807d5a,updated_at=2022-10-16T00:58:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:31.097082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (38519ed2-4a30-472e-a699-0888b833a9fd), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.097513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:31.099446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:30Z,description=,direction='ingress',ethertype='IPv4',id=dda03b7b-543b-4ea5-8d74-b599c70626a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39d1c20705604f8794fb441271e5afd3',protocol=,remote_address_group_id=,remote_group_id=01165a5f-2892-45d5-a617-be5ac6807d5a,remote_ip_prefix=,revision_number=0,security_group_id=01165a5f-2892-45d5-a617-be5ac6807d5a,updated_at=2022-10-16T00:58:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:31.102597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dda03b7b-543b-4ea5-8d74-b599c70626a0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.105210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:31.106076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:30Z,description=,direction='egress',ethertype='IPv4',id=efa2436c-a3ed-4ff2-acad-4001f95a9e67,normalized_cidr=None,port_range_max=,port_range_min=,project_id='39d1c20705604f8794fb441271e5afd3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=01165a5f-2892-45d5-a617-be5ac6807d5a,updated_at=2022-10-16T00:58:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:31.106641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (efa2436c-a3ed-4ff2-acad-4001f95a9e67), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.107197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:31.135929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-096118b3-a822-4e41-af20-c5780337eb41 tempest-DeleteServersTestJSON-1247050903 tempest-DeleteServersTestJSON-1247050903-project] Resource Port deleted: 67ec654d-ac07-4f60-a537-631325285925 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:31.136318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-096118b3-a822-4e41-af20-c5780337eb41 tempest-DeleteServersTestJSON-1247050903 tempest-DeleteServersTestJSON-1247050903-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (67ec654d-ac07-4f60-a537-631325285925), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.136938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-096118b3-a822-4e41-af20-c5780337eb41 tempest-DeleteServersTestJSON-1247050903 tempest-DeleteServersTestJSON-1247050903-project] Security group member updated {'3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'} Oct 16 00:58:31.818014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:58:30Z,data_plane_status=None,description='',device_id='2e7f0234-5efd-4ff6-aad5-e5bec370a100',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fbe04689-7374-4408-a0a0-f4d388dc670b,mac_address=fa:16:3e:4d:57:cc,name='',network_id=78cb0413-355e-4553-afe2-d7730c4559d0,numa_affinity_policy=,project_id='39d1c20705604f8794fb441271e5afd3',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fbe04689-7374-4408-a0a0-f4d388dc670b),security_group_ids=set([01165a5f-2892-45d5-a617-be5ac6807d5a]),status='DOWN',updated_at=2022-10-16T00:58:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:31.819055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fbe04689-7374-4408-a0a0-f4d388dc670b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:31.820479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0a43929-bad4-41ed-93c1-10b199680f7e tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Security group member updated {'01165a5f-2892-45d5-a617-be5ac6807d5a'} Oct 16 00:58:32.304548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:32Z,description='Default security group',id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,is_default=True,name='default',project_id='1fbf3a4d437f48a0bab6f7d5ed18d307',revision_number=1,rules=[SecurityGroupRule(8e49a83e-c43b-42bf-9d4c-54677d070ed9),SecurityGroupRule(9d261265-cc31-4b28-95be-79872578f79e),SecurityGroupRule(b64dc426-623d-4ef4-b263-9a0908ce640d),SecurityGroupRule(e067303c-1946-4b95-8e85-42f453f34d23)],shared=False,stateful=True,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:32.305240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.305558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='ingress',ethertype='IPv6',id=8e49a83e-c43b-42bf-9d4c-54677d070ed9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fbf3a4d437f48a0bab6f7d5ed18d307',protocol=,remote_address_group_id=,remote_group_id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,remote_ip_prefix=,revision_number=0,security_group_id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:32.305922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8e49a83e-c43b-42bf-9d4c-54677d070ed9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.306507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.307283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='ingress',ethertype='IPv4',id=9d261265-cc31-4b28-95be-79872578f79e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fbf3a4d437f48a0bab6f7d5ed18d307',protocol=,remote_address_group_id=,remote_group_id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,remote_ip_prefix=,revision_number=0,security_group_id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:32.307916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9d261265-cc31-4b28-95be-79872578f79e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.308462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.309201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='egress',ethertype='IPv6',id=b64dc426-623d-4ef4-b263-9a0908ce640d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fbf3a4d437f48a0bab6f7d5ed18d307',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:32.309626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b64dc426-623d-4ef4-b263-9a0908ce640d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.310029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.310817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='egress',ethertype='IPv4',id=e067303c-1946-4b95-8e85-42f453f34d23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fbf3a4d437f48a0bab6f7d5ed18d307',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:32.311272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e067303c-1946-4b95-8e85-42f453f34d23), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.311671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc33a6eb-ca3b-432f-81ce-a5314bc2ac98 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.460184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Resource SecurityGroup deleted: b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:32.461441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.464550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:32.507781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:32.508625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Resource SecurityGroupRule deleted: 8e49a83e-c43b-42bf-9d4c-54677d070ed9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:32.509201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8e49a83e-c43b-42bf-9d4c-54677d070ed9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.509735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.510632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Resource SecurityGroupRule deleted: 9d261265-cc31-4b28-95be-79872578f79e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:32.511380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9d261265-cc31-4b28-95be-79872578f79e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.511952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.512518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Resource SecurityGroupRule deleted: b64dc426-623d-4ef4-b263-9a0908ce640d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:32.513086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b64dc426-623d-4ef4-b263-9a0908ce640d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.513500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.514096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Resource SecurityGroupRule deleted: e067303c-1946-4b95-8e85-42f453f34d23 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:32.514675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e067303c-1946-4b95-8e85-42f453f34d23), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:32.515117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8b3d6c86-a805-44ae-a546-27fec943f6d8 admin admin] Security group rule updated ['b4e8b2de-8ae3-4eb3-864c-6b7ea966c1de'] Oct 16 00:58:32.739632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8c11e199-48d0-4e69-bd47-07a2dd397503 service neutron] Resource Port fbe04689-7374-4408-a0a0-f4d388dc670b updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=fbe04689-7374-4408-a0a0-f4d388dc670b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=fbe04689-7374-4408-a0a0-f4d388dc670b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:32.740026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8c11e199-48d0-4e69-bd47-07a2dd397503 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fbe04689-7374-4408-a0a0-f4d388dc670b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.047206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:273 started Oct 16 00:58:33.053047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=693000000,duration_sec=579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:33.053047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:33.055875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:273 - starting polling. Elapsed:0.006 Oct 16 00:58:33.059876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.067150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 67ec654d-ac07-4f60-a537-631325285925 not present in bridge br-int Oct 16 00:58:33.067760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 00:58:33.070330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['67ec654d-ac07-4f60-a537-631325285925'] Oct 16 00:58:33.071173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 67ec654d-ac07-4f60-a537-631325285925 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 00:58:33.080334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:273 - port information retrieved. Elapsed:0.033 Oct 16 00:58:33.080934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.034 Oct 16 00:58:33.169965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:32Z,description='Default security group',id=77661f1c-eba6-4a03-8d5f-354932abdc4e,is_default=True,name='default',project_id='9eca102f1d9749a3a2723f07db30f289',revision_number=1,rules=[SecurityGroupRule(13b086a0-c09f-4fd2-b049-407e38d43690),SecurityGroupRule(23d3d30b-dc23-4bc9-b25b-553bbf244a5a),SecurityGroupRule(9294de95-690d-466c-9784-2ff84814a680),SecurityGroupRule(d1d29ee0-d88f-48a3-86e9-8c66a52f8a5e)],shared=False,stateful=True,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:33.170483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (77661f1c-eba6-4a03-8d5f-354932abdc4e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.171171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='egress',ethertype='IPv4',id=13b086a0-c09f-4fd2-b049-407e38d43690,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eca102f1d9749a3a2723f07db30f289',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=77661f1c-eba6-4a03-8d5f-354932abdc4e,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:33.171757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (13b086a0-c09f-4fd2-b049-407e38d43690), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.172445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.173364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='egress',ethertype='IPv6',id=23d3d30b-dc23-4bc9-b25b-553bbf244a5a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eca102f1d9749a3a2723f07db30f289',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=77661f1c-eba6-4a03-8d5f-354932abdc4e,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:33.174016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (23d3d30b-dc23-4bc9-b25b-553bbf244a5a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.174747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.176412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='ingress',ethertype='IPv6',id=9294de95-690d-466c-9784-2ff84814a680,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eca102f1d9749a3a2723f07db30f289',protocol=,remote_address_group_id=,remote_group_id=77661f1c-eba6-4a03-8d5f-354932abdc4e,remote_ip_prefix=,revision_number=0,security_group_id=77661f1c-eba6-4a03-8d5f-354932abdc4e,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:33.177075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9294de95-690d-466c-9784-2ff84814a680), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.177528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.179290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:32Z,description=,direction='ingress',ethertype='IPv4',id=d1d29ee0-d88f-48a3-86e9-8c66a52f8a5e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eca102f1d9749a3a2723f07db30f289',protocol=,remote_address_group_id=,remote_group_id=77661f1c-eba6-4a03-8d5f-354932abdc4e,remote_ip_prefix=,revision_number=0,security_group_id=77661f1c-eba6-4a03-8d5f-354932abdc4e,updated_at=2022-10-16T00:58:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:33.180257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d1d29ee0-d88f-48a3-86e9-8c66a52f8a5e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.180601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cb8ddf42-f9fa-496e-b128-7f4dd5366866 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.192974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8c11e199-48d0-4e69-bd47-07a2dd397503 service neutron] Resource Port fbe04689-7374-4408-a0a0-f4d388dc670b updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=fbe04689-7374-4408-a0a0-f4d388dc670b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=fbe04689-7374-4408-a0a0-f4d388dc670b,segment=NetworkSegment(66c538ca-a052-43c4-af63-07b81c0c5e79),segment_id=66c538ca-a052-43c4-af63-07b81c0c5e79)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=fbe04689-7374-4408-a0a0-f4d388dc670b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:33.193367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8c11e199-48d0-4e69-bd47-07a2dd397503 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fbe04689-7374-4408-a0a0-f4d388dc670b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.502928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Resource SecurityGroup deleted: 77661f1c-eba6-4a03-8d5f-354932abdc4e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:33.514783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (77661f1c-eba6-4a03-8d5f-354932abdc4e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.515431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('77661f1c-eba6-4a03-8d5f-354932abdc4e',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:33.551571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('77661f1c-eba6-4a03-8d5f-354932abdc4e',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:33.552086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Resource SecurityGroupRule deleted: 13b086a0-c09f-4fd2-b049-407e38d43690 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:33.552468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (13b086a0-c09f-4fd2-b049-407e38d43690), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.554490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.554490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Resource SecurityGroupRule deleted: 23d3d30b-dc23-4bc9-b25b-553bbf244a5a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:33.554490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (23d3d30b-dc23-4bc9-b25b-553bbf244a5a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.555918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.556805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Resource SecurityGroupRule deleted: 9294de95-690d-466c-9784-2ff84814a680 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:33.560050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9294de95-690d-466c-9784-2ff84814a680), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.561629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:33.561956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Resource SecurityGroupRule deleted: d1d29ee0-d88f-48a3-86e9-8c66a52f8a5e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:33.562892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d1d29ee0-d88f-48a3-86e9-8c66a52f8a5e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:33.563723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9198404f-7845-44d9-ade2-30032fce8ae8 admin admin] Security group rule updated ['77661f1c-eba6-4a03-8d5f-354932abdc4e'] Oct 16 00:58:35.048355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:274 started Oct 16 00:58:35.051897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=695000000,duration_sec=581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:35.052977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:35.053526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:274 - starting polling. Elapsed:0.005 Oct 16 00:58:35.056251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:35.063500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:274 - port information retrieved. Elapsed:0.015 Oct 16 00:58:35.064722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 16 00:58:35.872385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77ee9b92-ed57-40c3-a461-6ae3c8cf3db7 admin admin] Resource Subnet deleted: 5e7c8763-28ee-4293-9560-4345d6255350 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:35.873253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77ee9b92-ed57-40c3-a461-6ae3c8cf3db7 admin admin] Publish callbacks [] for Subnet (5e7c8763-28ee-4293-9560-4345d6255350), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:36.559182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a0f58a9-92f2-4ffc-8c5e-4a5aa91f080e admin admin] Resource Port deleted: edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:36.559803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a0f58a9-92f2-4ffc-8c5e-4a5aa91f080e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (edc13d5b-c9f2-4dc4-a392-0e617cb7cd97), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:36.805460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c20c1706-df83-48b5-aa11-64573f165cfe admin admin] Resource Network deleted: 60ed8060-2b52-472c-bd81-6d2d3a8ca986 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:36.806198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c20c1706-df83-48b5-aa11-64573f165cfe admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (60ed8060-2b52-472c-bd81-6d2d3a8ca986), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:37.053140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:275 started Oct 16 00:58:37.055592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=699000000,duration_sec=583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:37.056214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:37.056612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:275 - starting polling. Elapsed:0.004 Oct 16 00:58:37.059883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:37.066412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-edc13d5b-c9, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:58:37.090624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-189116e2-e9ab-4865-a4e6-2f3b01aaeb4e admin admin] Resource Subnet deleted: ac4a82b5-ad59-4a60-aa54-b6fc731eff46 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:37.091043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-189116e2-e9ab-4865-a4e6-2f3b01aaeb4e admin admin] Publish callbacks [] for Subnet (ac4a82b5-ad59-4a60-aa54-b6fc731eff46), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:37.094072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d72,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:37.094503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['edc13d5b-c9f2-4dc4-a392-0e617cb7cd97'] Oct 16 00:58:37.095002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:58:37.189726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f740a7-c96f-4d19-b669-7d4607592e0f]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:58:37.193654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:275 - port information retrieved. Elapsed:0.141 Oct 16 00:58:37.194230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.141 Oct 16 00:58:37.948475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port fbe04689-7374-4408-a0a0-f4d388dc670b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:37.949307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fbe04689-7374-4408-a0a0-f4d388dc670b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:37.958573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a940e9c2-6691-46b7-865a-bbeb43067307 admin admin] Resource Network deleted: 6d8a5b87-a2be-47de-b247-66876e428dd8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:37.959820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a940e9c2-6691-46b7-865a-bbeb43067307 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (6d8a5b87-a2be-47de-b247-66876e428dd8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:38.556445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18e3c196-229b-42dd-b5ca-214f116acef6","delete","qr-edc13d5b-c9",13,["map",[["attached-mac","fa:16:3e:65:3e:2c"],["iface-id","edc13d5b-c9f2-4dc4-a392-0e617cb7cd97"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:58:38.650171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Resource SecurityGroup deleted: 52218b3c-54fc-499a-bfbd-25c31c268a13 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:38.651267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (52218b3c-54fc-499a-bfbd-25c31c268a13), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:38.651396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('52218b3c-54fc-499a-bfbd-25c31c268a13',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:38.672920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('52218b3c-54fc-499a-bfbd-25c31c268a13',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:38.674420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Resource SecurityGroupRule deleted: 187b3f02-2ea8-43d2-80b9-acc746d1ab93 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:38.675062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (187b3f02-2ea8-43d2-80b9-acc746d1ab93), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:38.675628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:38.678052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Resource SecurityGroupRule deleted: 1ab0badf-a851-41d2-9bb5-ac93110e2890 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:38.678426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1ab0badf-a851-41d2-9bb5-ac93110e2890), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:38.678781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:38.679820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Resource SecurityGroupRule deleted: b8f3f7e1-fbbf-4086-8e5b-b46782a7d793 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:38.680183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b8f3f7e1-fbbf-4086-8e5b-b46782a7d793), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:38.680593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:38.680960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Resource SecurityGroupRule deleted: f7bbe739-af69-4dde-aa91-dc35152321a6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:38.681248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f7bbe739-af69-4dde-aa91-dc35152321a6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:38.682775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3ad62ba7-12ac-4479-b8c1-2aaff79050ea admin admin] Security group rule updated ['52218b3c-54fc-499a-bfbd-25c31c268a13'] Oct 16 00:58:38.931053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5f9bfdbe-7386-4e7d-8a1b-3f8041a4628d admin admin] Resource Port deleted: 92fd08e3-e2b0-40c2-b892-f442ec78a775 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:38.931680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5f9bfdbe-7386-4e7d-8a1b-3f8041a4628d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (92fd08e3-e2b0-40c2-b892-f442ec78a775), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.054211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:276 started Oct 16 00:58:39.059068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=700000000,duration_sec=585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:39.059068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:39.059068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:276 - starting polling. Elapsed:0.005 Oct 16 00:58:39.061814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.066122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-92fd08e3-e2, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:58:39.084611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d76,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:39.085260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['92fd08e3-e2b0-40c2-b892-f442ec78a775'] Oct 16 00:58:39.086078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:58:39.185644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663f19c-df43-4191-8c1c-a6c382d0ac99]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:58:39.192285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d78,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:39.192617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:276 - port information retrieved. Elapsed:0.139 Oct 16 00:58:39.193063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '831df3a8-d68b-40e9-b52b-297c2989e047', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '92fd08e3-e2b0-40c2-b892-f442ec78a775', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': {'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:58:39.193561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:276 - agent port security group processed in 0.000 Oct 16 00:58:39.195690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 00:58:39.198959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97'} Oct 16 00:58:39.199556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port edc13d5b-c9f2-4dc4-a392-0e617cb7cd97 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 00:58:39.200058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'edc13d5b-c9f2-4dc4-a392-0e617cb7cd97'} removed Oct 16 00:58:39.277396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 00:58:39.278025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 00:58:39.278542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:276 - treat_devices_removed completed in 0.081 Oct 16 00:58:39.279047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:276 - ports processed. Elapsed:0.225 Oct 16 00:58:39.279682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.226 Oct 16 00:58:39.575603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port fbe04689-7374-4408-a0a0-f4d388dc670b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:58:39.576698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (fbe04689-7374-4408-a0a0-f4d388dc670b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.609720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["84e06250-05b2-4687-a5e2-da0328837d7b","delete","qg-92fd08e3-e2",7,["map",[["attached-mac","fa:16:3e:e5:01:66"],["iface-id","92fd08e3-e2b0-40c2-b892-f442ec78a775"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:58:39.728056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Resource SecurityGroup deleted: 68499fea-e4b3-426d-ad0a-b90a52f398f4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:39.728502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (68499fea-e4b3-426d-ad0a-b90a52f398f4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.729905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('68499fea-e4b3-426d-ad0a-b90a52f398f4',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:39.754524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('68499fea-e4b3-426d-ad0a-b90a52f398f4',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:39.755477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Resource SecurityGroupRule deleted: 15d8bcbc-caff-40f0-938b-427362715d86 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:39.755590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (15d8bcbc-caff-40f0-938b-427362715d86), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.755929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:39.756479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Resource SecurityGroupRule deleted: 333951a2-fb42-4f9f-b182-aa5d14d3fb3d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:39.756834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (333951a2-fb42-4f9f-b182-aa5d14d3fb3d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.757462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:39.757846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Resource SecurityGroupRule deleted: 69a4c9b4-580d-449e-ae65-cf0049207bc5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:39.759127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (69a4c9b4-580d-449e-ae65-cf0049207bc5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.759470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:39.761762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Resource SecurityGroupRule deleted: af7bdae8-030e-4315-b027-3f3046b5e169 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:39.762142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (af7bdae8-030e-4315-b027-3f3046b5e169), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:39.762479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e13cf7b2-a683-4f72-b962-952f90e5fc56 admin admin] Security group rule updated ['68499fea-e4b3-426d-ad0a-b90a52f398f4'] Oct 16 00:58:39.895614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d4cfb50-d757-47bf-807f-ce03cfc69ffc admin admin] Resource Subnet deleted: 8fb2b922-74d5-4cae-b397-0d0c25d2079f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:39.895982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d4cfb50-d757-47bf-807f-ce03cfc69ffc admin admin] Publish callbacks [] for Subnet (8fb2b922-74d5-4cae-b397-0d0c25d2079f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:40.137304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["302a2eb0-198a-47b2-88a1-d62577b8ddd6","delete","tap831df3a8-d6",6,["map",[["attached-mac","fa:16:3e:f9:89:d9"],["iface-id","831df3a8-d68b-40e9-b52b-297c2989e047"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:58:40.388776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-87be9523-07fa-4070-a016-b8e0e96d4eba admin admin] Resource Port deleted: 831df3a8-d68b-40e9-b52b-297c2989e047 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:40.389703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-87be9523-07fa-4070-a016-b8e0e96d4eba admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (831df3a8-d68b-40e9-b52b-297c2989e047), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:40.568176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb7a8618-31eb-4214-9d50-0ac4320c5946 None None] Resource Port deleted: 831df3a8-d68b-40e9-b52b-297c2989e047 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:40.568514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb7a8618-31eb-4214-9d50-0ac4320c5946 None None] Skipped duplicate delete event for 831df3a8-d68b-40e9-b52b-297c2989e047 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 00:58:40.716453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-87be9523-07fa-4070-a016-b8e0e96d4eba admin admin] Resource Network deleted: 987da718-4a64-4801-99fd-c8b997ad845b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:40.717311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-87be9523-07fa-4070-a016-b8e0e96d4eba admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (987da718-4a64-4801-99fd-c8b997ad845b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.044904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Resource SecurityGroup deleted: 3fac4e82-9a4f-452d-92ae-7c5d7772b1b0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.045377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3fac4e82-9a4f-452d-92ae-7c5d7772b1b0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.046251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3fac4e82-9a4f-452d-92ae-7c5d7772b1b0',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:41.055365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:277 started Oct 16 00:58:41.059557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=702000000,duration_sec=587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:41.061785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:41.061785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:277 - starting polling. Elapsed:0.006 Oct 16 00:58:41.075668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.078852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3fac4e82-9a4f-452d-92ae-7c5d7772b1b0',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:41.082514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Resource SecurityGroupRule deleted: 603e2948-9da6-4414-9afd-725f33276d83 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.082514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (603e2948-9da6-4414-9afd-725f33276d83), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.082514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:58:41.082514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Resource SecurityGroupRule deleted: 914fe685-0163-493b-9a19-7d727625cd3a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.082514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (914fe685-0163-493b-9a19-7d727625cd3a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.083522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:58:41.083522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Resource SecurityGroupRule deleted: c725f166-6281-4828-a8d0-5b389b180409 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.083522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c725f166-6281-4828-a8d0-5b389b180409), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.083522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:58:41.083522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Resource SecurityGroupRule deleted: fee1fb13-9077-49e3-b710-b84a139f8597 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.084875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fee1fb13-9077-49e3-b710-b84a139f8597), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.084875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0dc060f3-16a1-40ba-a63c-f38aa3044ce1 admin admin] Security group rule updated ['3fac4e82-9a4f-452d-92ae-7c5d7772b1b0'] Oct 16 00:58:41.086943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d7c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:41.091277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416d7e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:41.092045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:277 - port information retrieved. Elapsed:0.037 Oct 16 00:58:41.092191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': {'831df3a8-d68b-40e9-b52b-297c2989e047', '92fd08e3-e2b0-40c2-b892-f442ec78a775'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:58:41.092531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:277 - agent port security group processed in 0.000 Oct 16 00:58:41.094346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 00:58:41.094653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'831df3a8-d68b-40e9-b52b-297c2989e047', '92fd08e3-e2b0-40c2-b892-f442ec78a775'} Oct 16 00:58:41.095077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 92fd08e3-e2b0-40c2-b892-f442ec78a775 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 00:58:41.095441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:58:41.159989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c56f59-6f24-4de9-ad34-40e9e5dc4d8b]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:58:41.160926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'831df3a8-d68b-40e9-b52b-297c2989e047', '92fd08e3-e2b0-40c2-b892-f442ec78a775'} removed Oct 16 00:58:41.220564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 00:58:41.220657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 4 from net-id = 987da718-4a64-4801-99fd-c8b997ad845b, seg-id = 363 Oct 16 00:58:41.223696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8c8b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:41.226395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416d80,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4459}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:41.226825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 00:58:41.227262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:277 - treat_devices_removed completed in 0.132 Oct 16 00:58:41.227754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:277 - ports processed. Elapsed:0.172 Oct 16 00:58:41.228140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.173 Oct 16 00:58:41.786175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:41Z,description='Default security group',id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,is_default=True,name='default',project_id='217097ae31cf4319b2c373e5fc625d91',revision_number=1,rules=[SecurityGroupRule(41debb06-6feb-463a-8387-33bf2318daed),SecurityGroupRule(7dad349f-e1ef-4896-a39d-83e8baac9697),SecurityGroupRule(a677e32b-b3c7-434e-8891-258e44ffdc31),SecurityGroupRule(ea4b8b75-eac1-43f2-b0ad-0a5a9da00b0c)],shared=False,stateful=True,updated_at=2022-10-16T00:58:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:41.786573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (695f9ed9-dc36-4e4c-a4dd-b8965e45dd42), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.787852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:41Z,description=,direction='ingress',ethertype='IPv4',id=41debb06-6feb-463a-8387-33bf2318daed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='217097ae31cf4319b2c373e5fc625d91',protocol=,remote_address_group_id=,remote_group_id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,remote_ip_prefix=,revision_number=0,security_group_id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,updated_at=2022-10-16T00:58:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:41.789353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (41debb06-6feb-463a-8387-33bf2318daed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.789715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.790901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:41Z,description=,direction='ingress',ethertype='IPv6',id=7dad349f-e1ef-4896-a39d-83e8baac9697,normalized_cidr=None,port_range_max=,port_range_min=,project_id='217097ae31cf4319b2c373e5fc625d91',protocol=,remote_address_group_id=,remote_group_id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,remote_ip_prefix=,revision_number=0,security_group_id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,updated_at=2022-10-16T00:58:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:41.792467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7dad349f-e1ef-4896-a39d-83e8baac9697), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.792805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.793865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:41Z,description=,direction='egress',ethertype='IPv6',id=a677e32b-b3c7-434e-8891-258e44ffdc31,normalized_cidr=None,port_range_max=,port_range_min=,project_id='217097ae31cf4319b2c373e5fc625d91',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,updated_at=2022-10-16T00:58:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:41.794418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a677e32b-b3c7-434e-8891-258e44ffdc31), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.794938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.796356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:41Z,description=,direction='egress',ethertype='IPv4',id=ea4b8b75-eac1-43f2-b0ad-0a5a9da00b0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='217097ae31cf4319b2c373e5fc625d91',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=695f9ed9-dc36-4e4c-a4dd-b8965e45dd42,updated_at=2022-10-16T00:58:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:41.796997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ea4b8b75-eac1-43f2-b0ad-0a5a9da00b0c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.797563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a29a6f5-643d-4214-b7b7-8515872c7e56 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.974812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Resource SecurityGroup deleted: 695f9ed9-dc36-4e4c-a4dd-b8965e45dd42 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.975230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (695f9ed9-dc36-4e4c-a4dd-b8965e45dd42), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.975703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('695f9ed9-dc36-4e4c-a4dd-b8965e45dd42',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:41.991878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('695f9ed9-dc36-4e4c-a4dd-b8965e45dd42',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:41.992368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Resource SecurityGroupRule deleted: 41debb06-6feb-463a-8387-33bf2318daed {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.992746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (41debb06-6feb-463a-8387-33bf2318daed), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.993088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.993490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Resource SecurityGroupRule deleted: 7dad349f-e1ef-4896-a39d-83e8baac9697 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.993846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7dad349f-e1ef-4896-a39d-83e8baac9697), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.994528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.994939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Resource SecurityGroupRule deleted: a677e32b-b3c7-434e-8891-258e44ffdc31 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.995298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a677e32b-b3c7-434e-8891-258e44ffdc31), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.996304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:41.997089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Resource SecurityGroupRule deleted: ea4b8b75-eac1-43f2-b0ad-0a5a9da00b0c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:41.997785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ea4b8b75-eac1-43f2-b0ad-0a5a9da00b0c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:41.998605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b064070b-ab94-4e41-bc32-e731a5e4b1f5 admin admin] Security group rule updated ['695f9ed9-dc36-4e4c-a4dd-b8965e45dd42'] Oct 16 00:58:42.342683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:42Z,description='Default security group',id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,is_default=True,name='default',project_id='809f1bfaf9db45ccaa61dd5d5aa0cee7',revision_number=1,rules=[SecurityGroupRule(1667e4a3-195c-48ee-ada5-0fb1761b5af0),SecurityGroupRule(9142d22a-0260-47d4-b57e-8fd1544fe8e9),SecurityGroupRule(d2225950-dbeb-4e44-b77c-f14fbbecef5d),SecurityGroupRule(f686cdc4-4890-48c4-86fb-8c8865ea39b9)],shared=False,stateful=True,updated_at=2022-10-16T00:58:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:42.343426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (38a5a79e-b606-4c78-a3c0-1b7751ddbcf9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.344076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:42Z,description=,direction='ingress',ethertype='IPv4',id=1667e4a3-195c-48ee-ada5-0fb1761b5af0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='809f1bfaf9db45ccaa61dd5d5aa0cee7',protocol=,remote_address_group_id=,remote_group_id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,remote_ip_prefix=,revision_number=0,security_group_id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,updated_at=2022-10-16T00:58:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:42.344463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1667e4a3-195c-48ee-ada5-0fb1761b5af0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.344853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.345783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:42Z,description=,direction='egress',ethertype='IPv4',id=9142d22a-0260-47d4-b57e-8fd1544fe8e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='809f1bfaf9db45ccaa61dd5d5aa0cee7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,updated_at=2022-10-16T00:58:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:42.346472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9142d22a-0260-47d4-b57e-8fd1544fe8e9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.346856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.350821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:42Z,description=,direction='ingress',ethertype='IPv6',id=d2225950-dbeb-4e44-b77c-f14fbbecef5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='809f1bfaf9db45ccaa61dd5d5aa0cee7',protocol=,remote_address_group_id=,remote_group_id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,remote_ip_prefix=,revision_number=0,security_group_id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,updated_at=2022-10-16T00:58:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:42.351593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d2225950-dbeb-4e44-b77c-f14fbbecef5d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.352245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.352992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:42Z,description=,direction='egress',ethertype='IPv6',id=f686cdc4-4890-48c4-86fb-8c8865ea39b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='809f1bfaf9db45ccaa61dd5d5aa0cee7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38a5a79e-b606-4c78-a3c0-1b7751ddbcf9,updated_at=2022-10-16T00:58:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:42.355388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f686cdc4-4890-48c4-86fb-8c8865ea39b9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.356101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-35060955-778a-4b00-a9e5-69c3e0b6ab28 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.537251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Resource SecurityGroup deleted: 38a5a79e-b606-4c78-a3c0-1b7751ddbcf9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:42.537251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (38a5a79e-b606-4c78-a3c0-1b7751ddbcf9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.537251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('38a5a79e-b606-4c78-a3c0-1b7751ddbcf9',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:42.561745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('38a5a79e-b606-4c78-a3c0-1b7751ddbcf9',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:42.562420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Resource SecurityGroupRule deleted: 1667e4a3-195c-48ee-ada5-0fb1761b5af0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:42.562802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1667e4a3-195c-48ee-ada5-0fb1761b5af0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.563436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.563851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Resource SecurityGroupRule deleted: 9142d22a-0260-47d4-b57e-8fd1544fe8e9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:42.564211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9142d22a-0260-47d4-b57e-8fd1544fe8e9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.564543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.564958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Resource SecurityGroupRule deleted: d2225950-dbeb-4e44-b77c-f14fbbecef5d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:42.565311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d2225950-dbeb-4e44-b77c-f14fbbecef5d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.565643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:42.566026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Resource SecurityGroupRule deleted: f686cdc4-4890-48c4-86fb-8c8865ea39b9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:42.566381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f686cdc4-4890-48c4-86fb-8c8865ea39b9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:42.566705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f388c09c-15e9-44a1-b7af-fbad72269202 admin admin] Security group rule updated ['38a5a79e-b606-4c78-a3c0-1b7751ddbcf9'] Oct 16 00:58:43.057455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:278 started Oct 16 00:58:43.062044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=704000000,duration_sec=589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:43.063357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:43.064173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 00:58:43.185601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:43Z,description='Default security group',id=2ea562d9-2c62-4769-a6c9-10725fed7443,is_default=True,name='default',project_id='d4191f6b320a49b38e96260733c96dfd',revision_number=1,rules=[SecurityGroupRule(165cefa3-87f1-4806-9441-f58a2f9ff4b9),SecurityGroupRule(60037dbf-eefb-4356-bfdf-367a5e7c57a1),SecurityGroupRule(7f4f416f-4003-4cd7-b82a-8965b8e4c118),SecurityGroupRule(a7bef71d-a11f-40ec-b690-9a76db90449a)],shared=False,stateful=True,updated_at=2022-10-16T00:58:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:43.185983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2ea562d9-2c62-4769-a6c9-10725fed7443), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.186928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:43Z,description=,direction='ingress',ethertype='IPv6',id=165cefa3-87f1-4806-9441-f58a2f9ff4b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4191f6b320a49b38e96260733c96dfd',protocol=,remote_address_group_id=,remote_group_id=2ea562d9-2c62-4769-a6c9-10725fed7443,remote_ip_prefix=,revision_number=0,security_group_id=2ea562d9-2c62-4769-a6c9-10725fed7443,updated_at=2022-10-16T00:58:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:43.187072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (165cefa3-87f1-4806-9441-f58a2f9ff4b9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.187552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.188365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:43Z,description=,direction='egress',ethertype='IPv6',id=60037dbf-eefb-4356-bfdf-367a5e7c57a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4191f6b320a49b38e96260733c96dfd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ea562d9-2c62-4769-a6c9-10725fed7443,updated_at=2022-10-16T00:58:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:43.188792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (60037dbf-eefb-4356-bfdf-367a5e7c57a1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.189172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.190020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:43Z,description=,direction='egress',ethertype='IPv4',id=7f4f416f-4003-4cd7-b82a-8965b8e4c118,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4191f6b320a49b38e96260733c96dfd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ea562d9-2c62-4769-a6c9-10725fed7443,updated_at=2022-10-16T00:58:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:43.190378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7f4f416f-4003-4cd7-b82a-8965b8e4c118), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.190708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.191449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:43Z,description=,direction='ingress',ethertype='IPv4',id=a7bef71d-a11f-40ec-b690-9a76db90449a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d4191f6b320a49b38e96260733c96dfd',protocol=,remote_address_group_id=,remote_group_id=2ea562d9-2c62-4769-a6c9-10725fed7443,remote_ip_prefix=,revision_number=0,security_group_id=2ea562d9-2c62-4769-a6c9-10725fed7443,updated_at=2022-10-16T00:58:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:43.191744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a7bef71d-a11f-40ec-b690-9a76db90449a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.196182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2551a02b-afa5-4d69-bd06-b9dd08c2df54 admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.355846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Resource SecurityGroup deleted: 2ea562d9-2c62-4769-a6c9-10725fed7443 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:43.356685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (2ea562d9-2c62-4769-a6c9-10725fed7443), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.357568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2ea562d9-2c62-4769-a6c9-10725fed7443',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:43.380073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2ea562d9-2c62-4769-a6c9-10725fed7443',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:43.381050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Resource SecurityGroupRule deleted: 165cefa3-87f1-4806-9441-f58a2f9ff4b9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:43.381754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (165cefa3-87f1-4806-9441-f58a2f9ff4b9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.382400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.383366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Resource SecurityGroupRule deleted: 60037dbf-eefb-4356-bfdf-367a5e7c57a1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:43.383957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (60037dbf-eefb-4356-bfdf-367a5e7c57a1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.384542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.385211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Resource SecurityGroupRule deleted: 7f4f416f-4003-4cd7-b82a-8965b8e4c118 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:43.387475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7f4f416f-4003-4cd7-b82a-8965b8e4c118), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.388282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:43.388925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Resource SecurityGroupRule deleted: a7bef71d-a11f-40ec-b690-9a76db90449a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:43.389503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a7bef71d-a11f-40ec-b690-9a76db90449a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:43.390122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-519d7c29-1016-42f1-8624-40979d03d35d admin admin] Security group rule updated ['2ea562d9-2c62-4769-a6c9-10725fed7443'] Oct 16 00:58:45.018221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-92bc4321-a3eb-4a38-bff0-51f5d3a35b6d tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Resource Port deleted: fbe04689-7374-4408-a0a0-f4d388dc670b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:45.018853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-92bc4321-a3eb-4a38-bff0-51f5d3a35b6d tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (fbe04689-7374-4408-a0a0-f4d388dc670b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:45.019533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-92bc4321-a3eb-4a38-bff0-51f5d3a35b6d tempest-VolumesNegativeTest-476947040 tempest-VolumesNegativeTest-476947040-project] Security group member updated {'01165a5f-2892-45d5-a617-be5ac6807d5a'} Oct 16 00:58:45.063205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:279 started Oct 16 00:58:45.070152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=713000000,duration_sec=591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:45.071121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:45.071668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:279 - starting polling. Elapsed:0.012 Oct 16 00:58:45.073983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:45.076043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port fbe04689-7374-4408-a0a0-f4d388dc670b not present in bridge br-int Oct 16 00:58:45.076577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 00:58:45.077059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['fbe04689-7374-4408-a0a0-f4d388dc670b'] Oct 16 00:58:45.077740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port fbe04689-7374-4408-a0a0-f4d388dc670b is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 00:58:45.081692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:279 - port information retrieved. Elapsed:0.021 Oct 16 00:58:45.082283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Oct 16 00:58:47.063974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:280 started Oct 16 00:58:47.067705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=710000000,duration_sec=593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:47.068352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:47.068720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:58:48.485719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:48Z,description='Default security group',id=0f2840d2-33b9-4976-860d-208d5daa0931,is_default=True,name='default',project_id='103f30a9d97c4082ba59a10cc3bc218b',revision_number=1,rules=[SecurityGroupRule(17c7a9f0-6ed2-4647-9d14-4aa7245bee00),SecurityGroupRule(3076b88c-5178-40fa-bb11-576402c1f15d),SecurityGroupRule(438d5e61-f12b-4f2b-ac24-b247107dbd54),SecurityGroupRule(4bdc66b4-53f0-4fca-98b6-299082d24123)],shared=False,stateful=True,updated_at=2022-10-16T00:58:48Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:48.487062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (0f2840d2-33b9-4976-860d-208d5daa0931), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.488457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:48Z,description=,direction='egress',ethertype='IPv6',id=17c7a9f0-6ed2-4647-9d14-4aa7245bee00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='103f30a9d97c4082ba59a10cc3bc218b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f2840d2-33b9-4976-860d-208d5daa0931,updated_at=2022-10-16T00:58:48Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:48.488992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (17c7a9f0-6ed2-4647-9d14-4aa7245bee00), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.489724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.490969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:48Z,description=,direction='egress',ethertype='IPv4',id=3076b88c-5178-40fa-bb11-576402c1f15d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='103f30a9d97c4082ba59a10cc3bc218b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f2840d2-33b9-4976-860d-208d5daa0931,updated_at=2022-10-16T00:58:48Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:48.491258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3076b88c-5178-40fa-bb11-576402c1f15d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.491774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.492645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:48Z,description=,direction='ingress',ethertype='IPv6',id=438d5e61-f12b-4f2b-ac24-b247107dbd54,normalized_cidr=None,port_range_max=,port_range_min=,project_id='103f30a9d97c4082ba59a10cc3bc218b',protocol=,remote_address_group_id=,remote_group_id=0f2840d2-33b9-4976-860d-208d5daa0931,remote_ip_prefix=,revision_number=0,security_group_id=0f2840d2-33b9-4976-860d-208d5daa0931,updated_at=2022-10-16T00:58:48Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:48.493076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (438d5e61-f12b-4f2b-ac24-b247107dbd54), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.493468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.494293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:48Z,description=,direction='ingress',ethertype='IPv4',id=4bdc66b4-53f0-4fca-98b6-299082d24123,normalized_cidr=None,port_range_max=,port_range_min=,project_id='103f30a9d97c4082ba59a10cc3bc218b',protocol=,remote_address_group_id=,remote_group_id=0f2840d2-33b9-4976-860d-208d5daa0931,remote_ip_prefix=,revision_number=0,security_group_id=0f2840d2-33b9-4976-860d-208d5daa0931,updated_at=2022-10-16T00:58:48Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:48.494631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4bdc66b4-53f0-4fca-98b6-299082d24123), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.495057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a311c9b4-02db-4c4e-a487-8d8ad776493f admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.689385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Resource SecurityGroup deleted: 0f2840d2-33b9-4976-860d-208d5daa0931 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:48.689772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (0f2840d2-33b9-4976-860d-208d5daa0931), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.690236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0f2840d2-33b9-4976-860d-208d5daa0931',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:48.708418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0f2840d2-33b9-4976-860d-208d5daa0931',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:48.709582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Resource SecurityGroupRule deleted: 17c7a9f0-6ed2-4647-9d14-4aa7245bee00 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:48.709947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (17c7a9f0-6ed2-4647-9d14-4aa7245bee00), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.710571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.711102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Resource SecurityGroupRule deleted: 3076b88c-5178-40fa-bb11-576402c1f15d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:48.711583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3076b88c-5178-40fa-bb11-576402c1f15d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.712428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.713006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Resource SecurityGroupRule deleted: 438d5e61-f12b-4f2b-ac24-b247107dbd54 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:48.713701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (438d5e61-f12b-4f2b-ac24-b247107dbd54), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.714282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:48.714896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Resource SecurityGroupRule deleted: 4bdc66b4-53f0-4fca-98b6-299082d24123 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:48.715471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4bdc66b4-53f0-4fca-98b6-299082d24123), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:48.716032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77588282-937a-4fb2-9b48-b1b6dd4ffbe2 admin admin] Security group rule updated ['0f2840d2-33b9-4976-860d-208d5daa0931'] Oct 16 00:58:49.064495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:281 started Oct 16 00:58:49.068625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=711000000,duration_sec=595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:49.069489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:49.070086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 00:58:49.316855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:49Z,description='Default security group',id=d3364814-7393-49ec-97ac-d91424284f01,is_default=True,name='default',project_id='d49d0817c6b74a108b6bb1499b6fd482',revision_number=1,rules=[SecurityGroupRule(2863009c-de67-4f4c-bb52-d1add309fa3a),SecurityGroupRule(4451ef6d-d1e4-4cd7-8c9b-39d48f2baa55),SecurityGroupRule(4aa5c0c6-2396-405e-8224-98395093b7d5),SecurityGroupRule(6af71156-0917-4dc9-909f-e872f190ab52)],shared=False,stateful=True,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.317925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (d3364814-7393-49ec-97ac-d91424284f01), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.318941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='egress',ethertype='IPv4',id=2863009c-de67-4f4c-bb52-d1add309fa3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d49d0817c6b74a108b6bb1499b6fd482',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d3364814-7393-49ec-97ac-d91424284f01,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.319724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2863009c-de67-4f4c-bb52-d1add309fa3a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.320509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.324134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='ingress',ethertype='IPv6',id=4451ef6d-d1e4-4cd7-8c9b-39d48f2baa55,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d49d0817c6b74a108b6bb1499b6fd482',protocol=,remote_address_group_id=,remote_group_id=d3364814-7393-49ec-97ac-d91424284f01,remote_ip_prefix=,revision_number=0,security_group_id=d3364814-7393-49ec-97ac-d91424284f01,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.324943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4451ef6d-d1e4-4cd7-8c9b-39d48f2baa55), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.325961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.327164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='ingress',ethertype='IPv4',id=4aa5c0c6-2396-405e-8224-98395093b7d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d49d0817c6b74a108b6bb1499b6fd482',protocol=,remote_address_group_id=,remote_group_id=d3364814-7393-49ec-97ac-d91424284f01,remote_ip_prefix=,revision_number=0,security_group_id=d3364814-7393-49ec-97ac-d91424284f01,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.328101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4aa5c0c6-2396-405e-8224-98395093b7d5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.328729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.329762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='egress',ethertype='IPv6',id=6af71156-0917-4dc9-909f-e872f190ab52,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d49d0817c6b74a108b6bb1499b6fd482',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d3364814-7393-49ec-97ac-d91424284f01,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.330443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6af71156-0917-4dc9-909f-e872f190ab52), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.331019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8648dbc5-d981-4ac3-b1d5-d4034cbf1563 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.425506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:49Z,description='Default security group',id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,is_default=True,name='default',project_id='c4cc37c4e35e4247838082ded1a71a2c',revision_number=1,rules=[SecurityGroupRule(03caf01b-19de-4e25-90b0-a4974787d41d),SecurityGroupRule(659a6097-561e-4c80-ba16-5d18c0dd6d7a),SecurityGroupRule(e582d648-22be-4231-ade2-fda4c4a49203),SecurityGroupRule(fc3be450-f052-4887-af1d-4b1cb1cbe8ef)],shared=False,stateful=True,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.425896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.426592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='egress',ethertype='IPv4',id=03caf01b-19de-4e25-90b0-a4974787d41d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c4cc37c4e35e4247838082ded1a71a2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.427022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (03caf01b-19de-4e25-90b0-a4974787d41d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.427388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.428098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='egress',ethertype='IPv6',id=659a6097-561e-4c80-ba16-5d18c0dd6d7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c4cc37c4e35e4247838082ded1a71a2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.428509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (659a6097-561e-4c80-ba16-5d18c0dd6d7a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.428881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.432178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='ingress',ethertype='IPv6',id=e582d648-22be-4231-ade2-fda4c4a49203,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c4cc37c4e35e4247838082ded1a71a2c',protocol=,remote_address_group_id=,remote_group_id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,remote_ip_prefix=,revision_number=0,security_group_id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.432817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e582d648-22be-4231-ade2-fda4c4a49203), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.433193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.434107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:49Z,description=,direction='ingress',ethertype='IPv4',id=fc3be450-f052-4887-af1d-4b1cb1cbe8ef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c4cc37c4e35e4247838082ded1a71a2c',protocol=,remote_address_group_id=,remote_group_id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,remote_ip_prefix=,revision_number=0,security_group_id=3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec,updated_at=2022-10-16T00:58:49Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:49.435815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fc3be450-f052-4887-af1d-4b1cb1cbe8ef), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.435815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6ad69ccd-38c4-4799-a9e8-e02a6489dab6 admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.512803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Resource SecurityGroup deleted: d3364814-7393-49ec-97ac-d91424284f01 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.513429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (d3364814-7393-49ec-97ac-d91424284f01), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.513648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d3364814-7393-49ec-97ac-d91424284f01',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:49.536177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d3364814-7393-49ec-97ac-d91424284f01',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:49.536650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Resource SecurityGroupRule deleted: 2863009c-de67-4f4c-bb52-d1add309fa3a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.537605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2863009c-de67-4f4c-bb52-d1add309fa3a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.538314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.539375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Resource SecurityGroupRule deleted: 4451ef6d-d1e4-4cd7-8c9b-39d48f2baa55 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.539912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4451ef6d-d1e4-4cd7-8c9b-39d48f2baa55), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.541285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.541850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Resource SecurityGroupRule deleted: 4aa5c0c6-2396-405e-8224-98395093b7d5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.543203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4aa5c0c6-2396-405e-8224-98395093b7d5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.543787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.544313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Resource SecurityGroupRule deleted: 6af71156-0917-4dc9-909f-e872f190ab52 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.544809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6af71156-0917-4dc9-909f-e872f190ab52), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.545473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2080a935-34ad-42b7-bcf8-d338a434d972 admin admin] Security group rule updated ['d3364814-7393-49ec-97ac-d91424284f01'] Oct 16 00:58:49.640637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Resource SecurityGroup deleted: 3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.641750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.642693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:49.674799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:49.675613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Resource SecurityGroupRule deleted: 03caf01b-19de-4e25-90b0-a4974787d41d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.676235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (03caf01b-19de-4e25-90b0-a4974787d41d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.676670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.677236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Resource SecurityGroupRule deleted: 659a6097-561e-4c80-ba16-5d18c0dd6d7a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.677707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (659a6097-561e-4c80-ba16-5d18c0dd6d7a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.678432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.679262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Resource SecurityGroupRule deleted: e582d648-22be-4231-ade2-fda4c4a49203 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.680125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e582d648-22be-4231-ade2-fda4c4a49203), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.680595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:49.681396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Resource SecurityGroupRule deleted: fc3be450-f052-4887-af1d-4b1cb1cbe8ef {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:49.681873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fc3be450-f052-4887-af1d-4b1cb1cbe8ef), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:49.682327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd11da4a-a3d9-4396-803f-4f755e04940c admin admin] Security group rule updated ['3fd1c84c-09c5-4f81-bcb2-fcc1de2466ec'] Oct 16 00:58:50.251719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:50Z,description='Default security group',id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,is_default=True,name='default',project_id='0256e137c4ef4828823b77ceb13e5504',revision_number=1,rules=[SecurityGroupRule(20bcd889-cce6-4416-9899-7f0e726b164d),SecurityGroupRule(2f07b2c4-ec18-4243-af9d-50b797eac4a3),SecurityGroupRule(70c73dda-e2f9-4608-8726-d7882d9665ac),SecurityGroupRule(dca5fc2b-eefe-48d0-ba0a-13dbf5f73d7d)],shared=False,stateful=True,updated_at=2022-10-16T00:58:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:50.252187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.252888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:50Z,description=,direction='egress',ethertype='IPv6',id=20bcd889-cce6-4416-9899-7f0e726b164d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0256e137c4ef4828823b77ceb13e5504',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,updated_at=2022-10-16T00:58:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:50.254151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (20bcd889-cce6-4416-9899-7f0e726b164d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.254660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.255557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:50Z,description=,direction='ingress',ethertype='IPv4',id=2f07b2c4-ec18-4243-af9d-50b797eac4a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0256e137c4ef4828823b77ceb13e5504',protocol=,remote_address_group_id=,remote_group_id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,remote_ip_prefix=,revision_number=0,security_group_id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,updated_at=2022-10-16T00:58:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:50.256216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2f07b2c4-ec18-4243-af9d-50b797eac4a3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.257315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.258169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:50Z,description=,direction='ingress',ethertype='IPv6',id=70c73dda-e2f9-4608-8726-d7882d9665ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0256e137c4ef4828823b77ceb13e5504',protocol=,remote_address_group_id=,remote_group_id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,remote_ip_prefix=,revision_number=0,security_group_id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,updated_at=2022-10-16T00:58:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:50.258534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (70c73dda-e2f9-4608-8726-d7882d9665ac), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.258888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.259576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:50Z,description=,direction='egress',ethertype='IPv4',id=dca5fc2b-eefe-48d0-ba0a-13dbf5f73d7d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0256e137c4ef4828823b77ceb13e5504',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3,updated_at=2022-10-16T00:58:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:50.259929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dca5fc2b-eefe-48d0-ba0a-13dbf5f73d7d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.260264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-387fc334-93cf-4e48-804d-a02448e04c6c admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.439829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Resource SecurityGroup deleted: e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:50.440228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.440689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:50.460320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:50.460843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Resource SecurityGroupRule deleted: 20bcd889-cce6-4416-9899-7f0e726b164d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:50.461398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (20bcd889-cce6-4416-9899-7f0e726b164d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.462707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.463308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Resource SecurityGroupRule deleted: 2f07b2c4-ec18-4243-af9d-50b797eac4a3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:50.464622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2f07b2c4-ec18-4243-af9d-50b797eac4a3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.464969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.465606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Resource SecurityGroupRule deleted: 70c73dda-e2f9-4608-8726-d7882d9665ac {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:50.465925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (70c73dda-e2f9-4608-8726-d7882d9665ac), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.466252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:50.466668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Resource SecurityGroupRule deleted: dca5fc2b-eefe-48d0-ba0a-13dbf5f73d7d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:50.467245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dca5fc2b-eefe-48d0-ba0a-13dbf5f73d7d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:50.467729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a411b457-5c9e-4cff-a0d3-65936a70b6ed admin admin] Security group rule updated ['e68e23f5-16ba-45c0-ba7e-b6a170bc5ea3'] Oct 16 00:58:51.065482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:282 started Oct 16 00:58:51.068671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=711000000,duration_sec=597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:51.069264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:51.070001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:58:51.697003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Resource SecurityGroup deleted: 01165a5f-2892-45d5-a617-be5ac6807d5a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:51.699217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (01165a5f-2892-45d5-a617-be5ac6807d5a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:51.700495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('01165a5f-2892-45d5-a617-be5ac6807d5a',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:51.717405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('01165a5f-2892-45d5-a617-be5ac6807d5a',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:51.718333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Resource SecurityGroupRule deleted: 1157ee42-7008-45f0-b15a-2402ebb73b05 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:51.718816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1157ee42-7008-45f0-b15a-2402ebb73b05), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:51.719401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:51.719903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Resource SecurityGroupRule deleted: 38519ed2-4a30-472e-a699-0888b833a9fd {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:51.720357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (38519ed2-4a30-472e-a699-0888b833a9fd), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:51.721107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:51.721696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Resource SecurityGroupRule deleted: dda03b7b-543b-4ea5-8d74-b599c70626a0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:51.722280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dda03b7b-543b-4ea5-8d74-b599c70626a0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:51.722820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:51.723431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Resource SecurityGroupRule deleted: efa2436c-a3ed-4ff2-acad-4001f95a9e67 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:51.724033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (efa2436c-a3ed-4ff2-acad-4001f95a9e67), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:51.724597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9736fa23-2ac9-4b3d-aa76-67801bf681b6 admin admin] Security group rule updated ['01165a5f-2892-45d5-a617-be5ac6807d5a'] Oct 16 00:58:53.066597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:283 started Oct 16 00:58:53.074452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=713000000,duration_sec=599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:53.075418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:53.076418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 00:58:53.979351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:53Z,description='Default security group',id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,is_default=True,name='default',project_id='5073a7a54615493b8587ad0062b8b7a6',revision_number=1,rules=[SecurityGroupRule(00400d7a-f089-4135-aeb0-ac710e4526d8),SecurityGroupRule(004fcb87-3b2b-4675-a95c-253556c7e4d9),SecurityGroupRule(0ad2a2aa-ba92-459a-a7fb-b1e4ff149d00),SecurityGroupRule(8591f756-8070-45e0-b4ae-851bd563209e)],shared=False,stateful=True,updated_at=2022-10-16T00:58:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:53.979792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (b7a53f8f-2dc7-438d-9038-ee42f596b9fe), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:53.980400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:53Z,description=,direction='ingress',ethertype='IPv6',id=00400d7a-f089-4135-aeb0-ac710e4526d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5073a7a54615493b8587ad0062b8b7a6',protocol=,remote_address_group_id=,remote_group_id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,remote_ip_prefix=,revision_number=0,security_group_id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,updated_at=2022-10-16T00:58:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:53.980794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (00400d7a-f089-4135-aeb0-ac710e4526d8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:53.981172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:53.981862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:53Z,description=,direction='ingress',ethertype='IPv4',id=004fcb87-3b2b-4675-a95c-253556c7e4d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5073a7a54615493b8587ad0062b8b7a6',protocol=,remote_address_group_id=,remote_group_id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,remote_ip_prefix=,revision_number=0,security_group_id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,updated_at=2022-10-16T00:58:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:53.982225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (004fcb87-3b2b-4675-a95c-253556c7e4d9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:53.982560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:53.983267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:53Z,description=,direction='egress',ethertype='IPv4',id=0ad2a2aa-ba92-459a-a7fb-b1e4ff149d00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5073a7a54615493b8587ad0062b8b7a6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,updated_at=2022-10-16T00:58:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:53.983631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0ad2a2aa-ba92-459a-a7fb-b1e4ff149d00), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:53.983990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:53.984659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:53Z,description=,direction='egress',ethertype='IPv6',id=8591f756-8070-45e0-b4ae-851bd563209e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5073a7a54615493b8587ad0062b8b7a6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b7a53f8f-2dc7-438d-9038-ee42f596b9fe,updated_at=2022-10-16T00:58:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:53.985018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8591f756-8070-45e0-b4ae-851bd563209e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:53.985350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-548dbe2d-7b3e-40dd-848e-5b0f5e3fddb7 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:54.115165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Resource SecurityGroup deleted: b7a53f8f-2dc7-438d-9038-ee42f596b9fe {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.115740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (b7a53f8f-2dc7-438d-9038-ee42f596b9fe), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.116011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b7a53f8f-2dc7-438d-9038-ee42f596b9fe',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:54.133537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b7a53f8f-2dc7-438d-9038-ee42f596b9fe',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:54.134037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Resource SecurityGroupRule deleted: 00400d7a-f089-4135-aeb0-ac710e4526d8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.134348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (00400d7a-f089-4135-aeb0-ac710e4526d8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.134754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:54.135104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Resource SecurityGroupRule deleted: 004fcb87-3b2b-4675-a95c-253556c7e4d9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.136241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (004fcb87-3b2b-4675-a95c-253556c7e4d9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.137256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:54.137784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Resource SecurityGroupRule deleted: 0ad2a2aa-ba92-459a-a7fb-b1e4ff149d00 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.138292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0ad2a2aa-ba92-459a-a7fb-b1e4ff149d00), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.138829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:54.139379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Resource SecurityGroupRule deleted: 8591f756-8070-45e0-b4ae-851bd563209e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.139870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8591f756-8070-45e0-b4ae-851bd563209e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.140347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e7b9d23-44c6-4965-955b-e3f0081ec9e9 admin admin] Security group rule updated ['b7a53f8f-2dc7-438d-9038-ee42f596b9fe'] Oct 16 00:58:54.548964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:58:54Z,description='Default security group',id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,is_default=True,name='default',project_id='3199ddb07797466cb5d88adf25a33d2c',revision_number=1,rules=[SecurityGroupRule(128e8f53-2d44-4373-96a2-a86c2c0876c9),SecurityGroupRule(9497e53e-d625-4b31-8bbc-023acdadce95),SecurityGroupRule(bef4c007-cc35-4de5-b741-6d8875bf32e6),SecurityGroupRule(fa3fb9cd-67ba-4052-8d1c-ee4de1343d8a)],shared=False,stateful=True,updated_at=2022-10-16T00:58:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:54.549568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.550187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:54Z,description=,direction='egress',ethertype='IPv4',id=128e8f53-2d44-4373-96a2-a86c2c0876c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3199ddb07797466cb5d88adf25a33d2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,updated_at=2022-10-16T00:58:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:54.550545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (128e8f53-2d44-4373-96a2-a86c2c0876c9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.550901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.551603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:54Z,description=,direction='egress',ethertype='IPv6',id=9497e53e-d625-4b31-8bbc-023acdadce95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3199ddb07797466cb5d88adf25a33d2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,updated_at=2022-10-16T00:58:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:54.551960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9497e53e-d625-4b31-8bbc-023acdadce95), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.552317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.552976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:54Z,description=,direction='ingress',ethertype='IPv4',id=bef4c007-cc35-4de5-b741-6d8875bf32e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3199ddb07797466cb5d88adf25a33d2c',protocol=,remote_address_group_id=,remote_group_id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,remote_ip_prefix=,revision_number=0,security_group_id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,updated_at=2022-10-16T00:58:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:54.553325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bef4c007-cc35-4de5-b741-6d8875bf32e6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.553658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.554315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:58:54Z,description=,direction='ingress',ethertype='IPv6',id=fa3fb9cd-67ba-4052-8d1c-ee4de1343d8a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3199ddb07797466cb5d88adf25a33d2c',protocol=,remote_address_group_id=,remote_group_id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,remote_ip_prefix=,revision_number=0,security_group_id=2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a,updated_at=2022-10-16T00:58:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:58:54.554669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fa3fb9cd-67ba-4052-8d1c-ee4de1343d8a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.555021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6f0dc3f8-232a-47dd-8887-683ff8027552 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.687237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Resource SecurityGroup deleted: 2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.687622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.688119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84778a36-567c-4d13-8503-939729341945 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:58:54.701897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84778a36-567c-4d13-8503-939729341945 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:58:54.702434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Resource SecurityGroupRule deleted: 128e8f53-2d44-4373-96a2-a86c2c0876c9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.702932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (128e8f53-2d44-4373-96a2-a86c2c0876c9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.703395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.703857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Resource SecurityGroupRule deleted: 9497e53e-d625-4b31-8bbc-023acdadce95 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.704293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9497e53e-d625-4b31-8bbc-023acdadce95), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.704687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.705065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Resource SecurityGroupRule deleted: bef4c007-cc35-4de5-b741-6d8875bf32e6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.705413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bef4c007-cc35-4de5-b741-6d8875bf32e6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.705741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:54.706110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Resource SecurityGroupRule deleted: fa3fb9cd-67ba-4052-8d1c-ee4de1343d8a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:58:54.706564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fa3fb9cd-67ba-4052-8d1c-ee4de1343d8a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:58:54.706922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84778a36-567c-4d13-8503-939729341945 admin admin] Security group rule updated ['2621a11a-48a9-4ed7-a3fc-2cfd3dc42d6a'] Oct 16 00:58:55.068051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:284 started Oct 16 00:58:55.070797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=714000000,duration_sec=601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:55.071552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:55.071926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:58:57.068653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:285 started Oct 16 00:58:57.071241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=714000000,duration_sec=603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:57.071814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:57.072174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:58:59.069628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:286 started Oct 16 00:58:59.072003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=715000000,duration_sec=605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:58:59.072574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:58:59.073568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:01.071027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:287 started Oct 16 00:59:01.075213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=717000000,duration_sec=607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:01.075213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:01.075213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:03.071488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:288 started Oct 16 00:59:03.074527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=717000000,duration_sec=609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:03.075131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:03.075488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:05.073088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:289 started Oct 16 00:59:05.075905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=719000000,duration_sec=611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:05.076483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:05.076849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:06.224350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:06Z,description='Default security group',id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,is_default=True,name='default',project_id='5f810e546f6641cabdf5eb3ba3469c6b',revision_number=1,rules=[SecurityGroupRule(a139da33-693a-45cd-9193-531377122d80),SecurityGroupRule(bd8b53c7-5d42-4d7f-85a8-7bbdf9d3652e),SecurityGroupRule(bf22de93-4141-40ab-8094-969fb5c72a07),SecurityGroupRule(c46ddedd-69e4-4edb-a2f0-496794f6df27)],shared=False,stateful=True,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.225056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (1dbf2295-4651-4b93-92c2-27d2dc88c33e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.225534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='ingress',ethertype='IPv4',id=a139da33-693a-45cd-9193-531377122d80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f810e546f6641cabdf5eb3ba3469c6b',protocol=,remote_address_group_id=,remote_group_id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,remote_ip_prefix=,revision_number=0,security_group_id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.225898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a139da33-693a-45cd-9193-531377122d80), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.226243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.226944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='egress',ethertype='IPv6',id=bd8b53c7-5d42-4d7f-85a8-7bbdf9d3652e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f810e546f6641cabdf5eb3ba3469c6b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.227308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bd8b53c7-5d42-4d7f-85a8-7bbdf9d3652e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.227790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.228446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='egress',ethertype='IPv4',id=bf22de93-4141-40ab-8094-969fb5c72a07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f810e546f6641cabdf5eb3ba3469c6b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.229362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bf22de93-4141-40ab-8094-969fb5c72a07), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.229869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.230654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='ingress',ethertype='IPv6',id=c46ddedd-69e4-4edb-a2f0-496794f6df27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f810e546f6641cabdf5eb3ba3469c6b',protocol=,remote_address_group_id=,remote_group_id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,remote_ip_prefix=,revision_number=0,security_group_id=1dbf2295-4651-4b93-92c2-27d2dc88c33e,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.231046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c46ddedd-69e4-4edb-a2f0-496794f6df27), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.231379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-839fb752-68cb-4a5b-9932-1e39737b4503 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.374445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Resource SecurityGroup deleted: 1dbf2295-4651-4b93-92c2-27d2dc88c33e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.374832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (1dbf2295-4651-4b93-92c2-27d2dc88c33e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.375679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1dbf2295-4651-4b93-92c2-27d2dc88c33e',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:06.391342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1dbf2295-4651-4b93-92c2-27d2dc88c33e',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:06.391898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Resource SecurityGroupRule deleted: a139da33-693a-45cd-9193-531377122d80 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.392417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a139da33-693a-45cd-9193-531377122d80), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.392724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.393255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Resource SecurityGroupRule deleted: bd8b53c7-5d42-4d7f-85a8-7bbdf9d3652e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.393827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bd8b53c7-5d42-4d7f-85a8-7bbdf9d3652e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.394316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.394690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Resource SecurityGroupRule deleted: bf22de93-4141-40ab-8094-969fb5c72a07 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.395065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bf22de93-4141-40ab-8094-969fb5c72a07), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.395387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.395784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Resource SecurityGroupRule deleted: c46ddedd-69e4-4edb-a2f0-496794f6df27 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.396121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c46ddedd-69e4-4edb-a2f0-496794f6df27), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.396688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-25c08d14-4693-48e2-9360-7472c66d89c1 admin admin] Security group rule updated ['1dbf2295-4651-4b93-92c2-27d2dc88c33e'] Oct 16 00:59:06.805848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:06Z,description='Default security group',id=9423202d-4929-4743-b735-68f0d85a0e27,is_default=True,name='default',project_id='6d3280811ab24bc884551d5446b5787b',revision_number=1,rules=[SecurityGroupRule(0341ed04-b55e-4d37-8f90-eef9b454f2b9),SecurityGroupRule(1899f0c7-737b-4235-a832-2c8b62fb2218),SecurityGroupRule(21e15e34-9bd8-42ee-936e-009406af3d60),SecurityGroupRule(b14c2fc9-0a90-4ec9-9652-f9325168d542)],shared=False,stateful=True,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.806240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (9423202d-4929-4743-b735-68f0d85a0e27), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.807542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='ingress',ethertype='IPv4',id=0341ed04-b55e-4d37-8f90-eef9b454f2b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d3280811ab24bc884551d5446b5787b',protocol=,remote_address_group_id=,remote_group_id=9423202d-4929-4743-b735-68f0d85a0e27,remote_ip_prefix=,revision_number=0,security_group_id=9423202d-4929-4743-b735-68f0d85a0e27,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.808106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0341ed04-b55e-4d37-8f90-eef9b454f2b9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.808543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.809234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='egress',ethertype='IPv4',id=1899f0c7-737b-4235-a832-2c8b62fb2218,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d3280811ab24bc884551d5446b5787b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9423202d-4929-4743-b735-68f0d85a0e27,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.809597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1899f0c7-737b-4235-a832-2c8b62fb2218), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.809932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.810625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='egress',ethertype='IPv6',id=21e15e34-9bd8-42ee-936e-009406af3d60,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d3280811ab24bc884551d5446b5787b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9423202d-4929-4743-b735-68f0d85a0e27,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.811175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (21e15e34-9bd8-42ee-936e-009406af3d60), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.811509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.812192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:06Z,description=,direction='ingress',ethertype='IPv6',id=b14c2fc9-0a90-4ec9-9652-f9325168d542,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d3280811ab24bc884551d5446b5787b',protocol=,remote_address_group_id=,remote_group_id=9423202d-4929-4743-b735-68f0d85a0e27,remote_ip_prefix=,revision_number=0,security_group_id=9423202d-4929-4743-b735-68f0d85a0e27,updated_at=2022-10-16T00:59:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:06.812532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b14c2fc9-0a90-4ec9-9652-f9325168d542), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.812863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bb5d1097-b4c9-4785-b78e-bddea2d14d3c admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.946242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Resource SecurityGroup deleted: 9423202d-4929-4743-b735-68f0d85a0e27 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.947154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (9423202d-4929-4743-b735-68f0d85a0e27), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.947785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9423202d-4929-4743-b735-68f0d85a0e27',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:06.961995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9423202d-4929-4743-b735-68f0d85a0e27',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:06.962451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Resource SecurityGroupRule deleted: 0341ed04-b55e-4d37-8f90-eef9b454f2b9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.962822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0341ed04-b55e-4d37-8f90-eef9b454f2b9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.963257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.963815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Resource SecurityGroupRule deleted: 1899f0c7-737b-4235-a832-2c8b62fb2218 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.964385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1899f0c7-737b-4235-a832-2c8b62fb2218), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.965002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.965379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Resource SecurityGroupRule deleted: 21e15e34-9bd8-42ee-936e-009406af3d60 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.965730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (21e15e34-9bd8-42ee-936e-009406af3d60), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.966054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:06.966429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Resource SecurityGroupRule deleted: b14c2fc9-0a90-4ec9-9652-f9325168d542 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:06.966773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b14c2fc9-0a90-4ec9-9652-f9325168d542), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:06.967125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-52150194-4d4c-41ef-b6c6-e39a29ea2238 admin admin] Security group rule updated ['9423202d-4929-4743-b735-68f0d85a0e27'] Oct 16 00:59:07.073869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:290 started Oct 16 00:59:07.076621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=719000000,duration_sec=613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:07.077562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:07.078003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:07.501205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:07Z,description='Default security group',id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,is_default=True,name='default',project_id='dec347208ed246f9a7c569f90c46f9ac',revision_number=1,rules=[SecurityGroupRule(c54bd7ba-a35a-4c40-b8a4-5f6a3f41a085),SecurityGroupRule(d83818fb-c59b-441d-9b78-cda022d7d7ba),SecurityGroupRule(e2cdf507-f0a4-44cc-943f-b218aaa44892),SecurityGroupRule(f1ea0456-7d12-4eb9-8287-72f23152f22a)],shared=False,stateful=True,updated_at=2022-10-16T00:59:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:07.501844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (ceb4e274-06dc-42f2-8675-20dc99fd67d0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.502591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:07Z,description=,direction='ingress',ethertype='IPv6',id=c54bd7ba-a35a-4c40-b8a4-5f6a3f41a085,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dec347208ed246f9a7c569f90c46f9ac',protocol=,remote_address_group_id=,remote_group_id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,remote_ip_prefix=,revision_number=0,security_group_id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,updated_at=2022-10-16T00:59:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:07.503092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c54bd7ba-a35a-4c40-b8a4-5f6a3f41a085), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.503552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.504348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:07Z,description=,direction='egress',ethertype='IPv6',id=d83818fb-c59b-441d-9b78-cda022d7d7ba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dec347208ed246f9a7c569f90c46f9ac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,updated_at=2022-10-16T00:59:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:07.504903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d83818fb-c59b-441d-9b78-cda022d7d7ba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.505303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.506152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:07Z,description=,direction='ingress',ethertype='IPv4',id=e2cdf507-f0a4-44cc-943f-b218aaa44892,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dec347208ed246f9a7c569f90c46f9ac',protocol=,remote_address_group_id=,remote_group_id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,remote_ip_prefix=,revision_number=0,security_group_id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,updated_at=2022-10-16T00:59:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:07.506649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e2cdf507-f0a4-44cc-943f-b218aaa44892), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.507164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.508146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:07Z,description=,direction='egress',ethertype='IPv4',id=f1ea0456-7d12-4eb9-8287-72f23152f22a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dec347208ed246f9a7c569f90c46f9ac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ceb4e274-06dc-42f2-8675-20dc99fd67d0,updated_at=2022-10-16T00:59:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:07.508514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f1ea0456-7d12-4eb9-8287-72f23152f22a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.508847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a864e720-85ac-4d4a-a0cf-e2569d4ef91d admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.642885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Resource SecurityGroup deleted: ceb4e274-06dc-42f2-8675-20dc99fd67d0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:07.643257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (ceb4e274-06dc-42f2-8675-20dc99fd67d0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.643728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ceb4e274-06dc-42f2-8675-20dc99fd67d0',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:07.659988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ceb4e274-06dc-42f2-8675-20dc99fd67d0',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:07.660450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Resource SecurityGroupRule deleted: c54bd7ba-a35a-4c40-b8a4-5f6a3f41a085 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:07.660900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c54bd7ba-a35a-4c40-b8a4-5f6a3f41a085), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.661283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.661687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Resource SecurityGroupRule deleted: d83818fb-c59b-441d-9b78-cda022d7d7ba {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:07.662045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d83818fb-c59b-441d-9b78-cda022d7d7ba), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.662376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.662756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Resource SecurityGroupRule deleted: e2cdf507-f0a4-44cc-943f-b218aaa44892 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:07.663203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e2cdf507-f0a4-44cc-943f-b218aaa44892), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.663530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:07.663905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Resource SecurityGroupRule deleted: f1ea0456-7d12-4eb9-8287-72f23152f22a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:07.664281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f1ea0456-7d12-4eb9-8287-72f23152f22a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:07.664608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09e3ee25-53ed-4429-8a55-06ebb9585a6e admin admin] Security group rule updated ['ceb4e274-06dc-42f2-8675-20dc99fd67d0'] Oct 16 00:59:09.075274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:291 started Oct 16 00:59:09.078350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=721000000,duration_sec=615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:09.078977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:09.079341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:11.076264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:292 started Oct 16 00:59:11.078854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416d9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=722000000,duration_sec=617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:11.079459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:11.079815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:11.922453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:11Z,description='Default security group',id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,is_default=True,name='default',project_id='ed6d1bcd141e4a46a88a759f744a4fe2',revision_number=1,rules=[SecurityGroupRule(27ea904c-a6cc-475b-bcc4-03209bb8048b),SecurityGroupRule(30836b7a-bd29-4076-a747-a2987c67fbdc),SecurityGroupRule(ae2da02e-f8d8-419c-ac80-589d94ad608d),SecurityGroupRule(f603d296-3481-484c-a84e-30f81db304b0)],shared=False,stateful=True,updated_at=2022-10-16T00:59:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:11.922848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (25566c0e-60c1-4153-aba1-f9f0b9691bc2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:11.923508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:11Z,description=,direction='ingress',ethertype='IPv4',id=27ea904c-a6cc-475b-bcc4-03209bb8048b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed6d1bcd141e4a46a88a759f744a4fe2',protocol=,remote_address_group_id=,remote_group_id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,remote_ip_prefix=,revision_number=0,security_group_id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,updated_at=2022-10-16T00:59:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:11.923882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (27ea904c-a6cc-475b-bcc4-03209bb8048b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:11.924409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:11.925128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:11Z,description=,direction='egress',ethertype='IPv6',id=30836b7a-bd29-4076-a747-a2987c67fbdc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed6d1bcd141e4a46a88a759f744a4fe2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,updated_at=2022-10-16T00:59:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:11.925495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (30836b7a-bd29-4076-a747-a2987c67fbdc), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:11.925833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:11.926503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:11Z,description=,direction='ingress',ethertype='IPv6',id=ae2da02e-f8d8-419c-ac80-589d94ad608d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed6d1bcd141e4a46a88a759f744a4fe2',protocol=,remote_address_group_id=,remote_group_id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,remote_ip_prefix=,revision_number=0,security_group_id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,updated_at=2022-10-16T00:59:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:11.926891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ae2da02e-f8d8-419c-ac80-589d94ad608d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:11.927233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:11.927897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:11Z,description=,direction='egress',ethertype='IPv4',id=f603d296-3481-484c-a84e-30f81db304b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed6d1bcd141e4a46a88a759f744a4fe2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=25566c0e-60c1-4153-aba1-f9f0b9691bc2,updated_at=2022-10-16T00:59:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:11.928258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f603d296-3481-484c-a84e-30f81db304b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:11.928592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ba0e6950-2e8a-4b10-93b4-03b3ed6eb6e4 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:12.076133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Resource SecurityGroup deleted: 25566c0e-60c1-4153-aba1-f9f0b9691bc2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:12.076528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (25566c0e-60c1-4153-aba1-f9f0b9691bc2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:12.077295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('25566c0e-60c1-4153-aba1-f9f0b9691bc2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:12.100365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('25566c0e-60c1-4153-aba1-f9f0b9691bc2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:12.101193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Resource SecurityGroupRule deleted: 27ea904c-a6cc-475b-bcc4-03209bb8048b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:12.101627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (27ea904c-a6cc-475b-bcc4-03209bb8048b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:12.102277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:12.102889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Resource SecurityGroupRule deleted: 30836b7a-bd29-4076-a747-a2987c67fbdc {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:12.104569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (30836b7a-bd29-4076-a747-a2987c67fbdc), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:12.105124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:12.105530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Resource SecurityGroupRule deleted: ae2da02e-f8d8-419c-ac80-589d94ad608d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:12.106325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ae2da02e-f8d8-419c-ac80-589d94ad608d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:12.106903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:12.107754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Resource SecurityGroupRule deleted: f603d296-3481-484c-a84e-30f81db304b0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:12.108111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f603d296-3481-484c-a84e-30f81db304b0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:12.108790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-36abb101-d614-41e0-9a73-1ccd3a5fae51 admin admin] Security group rule updated ['25566c0e-60c1-4153-aba1-f9f0b9691bc2'] Oct 16 00:59:13.076751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:293 started Oct 16 00:59:13.079967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416da0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=722000000,duration_sec=619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:13.080593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:13.080954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:13.578155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:13Z,description='Default security group',id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,is_default=True,name='default',project_id='6569740dcccd4d4e979ea3c6f8d4b03a',revision_number=1,rules=[SecurityGroupRule(075da5b8-7de8-45b6-8d63-c2a28bb2ba10),SecurityGroupRule(277ebb1d-6da3-414e-9b25-6fff141bfd7e),SecurityGroupRule(8882a688-c6ef-4302-b057-b399e33f2f23),SecurityGroupRule(900348f6-7f95-44b5-976b-0a41c305dc2d)],shared=False,stateful=True,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.578621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (8538d1c9-20e5-4e68-ae47-643005a5c3e8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.579301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='ingress',ethertype='IPv4',id=075da5b8-7de8-45b6-8d63-c2a28bb2ba10,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6569740dcccd4d4e979ea3c6f8d4b03a',protocol=,remote_address_group_id=,remote_group_id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,remote_ip_prefix=,revision_number=0,security_group_id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.580402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (075da5b8-7de8-45b6-8d63-c2a28bb2ba10), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.580748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.581446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='egress',ethertype='IPv6',id=277ebb1d-6da3-414e-9b25-6fff141bfd7e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6569740dcccd4d4e979ea3c6f8d4b03a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.581803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (277ebb1d-6da3-414e-9b25-6fff141bfd7e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.582390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.583231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='ingress',ethertype='IPv6',id=8882a688-c6ef-4302-b057-b399e33f2f23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6569740dcccd4d4e979ea3c6f8d4b03a',protocol=,remote_address_group_id=,remote_group_id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,remote_ip_prefix=,revision_number=0,security_group_id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.583777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8882a688-c6ef-4302-b057-b399e33f2f23), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.584266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.585079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='egress',ethertype='IPv4',id=900348f6-7f95-44b5-976b-0a41c305dc2d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6569740dcccd4d4e979ea3c6f8d4b03a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8538d1c9-20e5-4e68-ae47-643005a5c3e8,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.585601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (900348f6-7f95-44b5-976b-0a41c305dc2d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.586094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27f40a81-6775-4b36-b537-f738e2e2287f admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.728629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Resource SecurityGroup deleted: 8538d1c9-20e5-4e68-ae47-643005a5c3e8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:13.729025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (8538d1c9-20e5-4e68-ae47-643005a5c3e8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.729502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8538d1c9-20e5-4e68-ae47-643005a5c3e8',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:13.753616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8538d1c9-20e5-4e68-ae47-643005a5c3e8',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:13.754225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Resource SecurityGroupRule deleted: 075da5b8-7de8-45b6-8d63-c2a28bb2ba10 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:13.754655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (075da5b8-7de8-45b6-8d63-c2a28bb2ba10), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.755279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.756026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Resource SecurityGroupRule deleted: 277ebb1d-6da3-414e-9b25-6fff141bfd7e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:13.756838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (277ebb1d-6da3-414e-9b25-6fff141bfd7e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.757178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.757583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Resource SecurityGroupRule deleted: 8882a688-c6ef-4302-b057-b399e33f2f23 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:13.757935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8882a688-c6ef-4302-b057-b399e33f2f23), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.758274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.758727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Resource SecurityGroupRule deleted: 900348f6-7f95-44b5-976b-0a41c305dc2d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:13.759197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (900348f6-7f95-44b5-976b-0a41c305dc2d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.760336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f1424cf6-f170-4bc7-87bd-1cecc77d23ac admin admin] Security group rule updated ['8538d1c9-20e5-4e68-ae47-643005a5c3e8'] Oct 16 00:59:13.842683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:13Z,description='Default security group',id=74964cd7-0667-43c5-8164-2c42a3bd5296,is_default=True,name='default',project_id='9d77c179761547f38c5eea8ddd4ec597',revision_number=1,rules=[SecurityGroupRule(0435f000-5237-41b0-bb69-e5aebe6401de),SecurityGroupRule(16585ab7-1a59-4e4a-a40b-0a62a48c77b5),SecurityGroupRule(bbb57770-f4c0-4219-92f2-4d3de571953c),SecurityGroupRule(d6e7f415-7a9d-4ac5-828d-0a6231664634)],shared=False,stateful=True,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.843664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (74964cd7-0667-43c5-8164-2c42a3bd5296), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.844960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='egress',ethertype='IPv6',id=0435f000-5237-41b0-bb69-e5aebe6401de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9d77c179761547f38c5eea8ddd4ec597',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=74964cd7-0667-43c5-8164-2c42a3bd5296,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.845506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0435f000-5237-41b0-bb69-e5aebe6401de), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.845924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:13.846903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='ingress',ethertype='IPv6',id=16585ab7-1a59-4e4a-a40b-0a62a48c77b5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9d77c179761547f38c5eea8ddd4ec597',protocol=,remote_address_group_id=,remote_group_id=74964cd7-0667-43c5-8164-2c42a3bd5296,remote_ip_prefix=,revision_number=0,security_group_id=74964cd7-0667-43c5-8164-2c42a3bd5296,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.848612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (16585ab7-1a59-4e4a-a40b-0a62a48c77b5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.849183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:13.850087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='ingress',ethertype='IPv4',id=bbb57770-f4c0-4219-92f2-4d3de571953c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9d77c179761547f38c5eea8ddd4ec597',protocol=,remote_address_group_id=,remote_group_id=74964cd7-0667-43c5-8164-2c42a3bd5296,remote_ip_prefix=,revision_number=0,security_group_id=74964cd7-0667-43c5-8164-2c42a3bd5296,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.850649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bbb57770-f4c0-4219-92f2-4d3de571953c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.851203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:13.852049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:13Z,description=,direction='egress',ethertype='IPv4',id=d6e7f415-7a9d-4ac5-828d-0a6231664634,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9d77c179761547f38c5eea8ddd4ec597',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=74964cd7-0667-43c5-8164-2c42a3bd5296,updated_at=2022-10-16T00:59:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:13.853701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d6e7f415-7a9d-4ac5-828d-0a6231664634), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.854288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-71ebcefb-fbeb-48aa-bf62-8600b2cd86bf admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:13.991616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Resource SecurityGroup deleted: 74964cd7-0667-43c5-8164-2c42a3bd5296 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:13.992190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (74964cd7-0667-43c5-8164-2c42a3bd5296), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:13.992683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('74964cd7-0667-43c5-8164-2c42a3bd5296',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:14.013239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('74964cd7-0667-43c5-8164-2c42a3bd5296',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:14.014020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Resource SecurityGroupRule deleted: 0435f000-5237-41b0-bb69-e5aebe6401de {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.014950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0435f000-5237-41b0-bb69-e5aebe6401de), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.015464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:14.016176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Resource SecurityGroupRule deleted: 16585ab7-1a59-4e4a-a40b-0a62a48c77b5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.017020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (16585ab7-1a59-4e4a-a40b-0a62a48c77b5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.018265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:14.018808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Resource SecurityGroupRule deleted: bbb57770-f4c0-4219-92f2-4d3de571953c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.019466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bbb57770-f4c0-4219-92f2-4d3de571953c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.019941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:14.020465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Resource SecurityGroupRule deleted: d6e7f415-7a9d-4ac5-828d-0a6231664634 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.020981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d6e7f415-7a9d-4ac5-828d-0a6231664634), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.021466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1b20cb10-392e-4cb6-80a8-023b1f8d5e44 admin admin] Security group rule updated ['74964cd7-0667-43c5-8164-2c42a3bd5296'] Oct 16 00:59:14.502719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:14Z,description='Default security group',id=2f204426-eae7-4ac6-a3cc-b535336c53ca,is_default=True,name='default',project_id='ad38d71b8bad4b6ab371191320ea8faf',revision_number=1,rules=[SecurityGroupRule(294963f2-17ba-416b-a8f6-3e73817742c5),SecurityGroupRule(34aaa0e5-0110-461f-b5bb-2e088b6eed94),SecurityGroupRule(3715c374-3142-4b78-bb44-8d025e7fb38a),SecurityGroupRule(eb3ed364-150f-4150-9bef-139280ea68e3)],shared=False,stateful=True,updated_at=2022-10-16T00:59:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:14.503452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2f204426-eae7-4ac6-a3cc-b535336c53ca), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.504022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:14Z,description=,direction='egress',ethertype='IPv4',id=294963f2-17ba-416b-a8f6-3e73817742c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad38d71b8bad4b6ab371191320ea8faf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2f204426-eae7-4ac6-a3cc-b535336c53ca,updated_at=2022-10-16T00:59:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:14.504425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (294963f2-17ba-416b-a8f6-3e73817742c5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.504746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.505979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:14Z,description=,direction='egress',ethertype='IPv6',id=34aaa0e5-0110-461f-b5bb-2e088b6eed94,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad38d71b8bad4b6ab371191320ea8faf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2f204426-eae7-4ac6-a3cc-b535336c53ca,updated_at=2022-10-16T00:59:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:14.506515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (34aaa0e5-0110-461f-b5bb-2e088b6eed94), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.506854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.507586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:14Z,description=,direction='ingress',ethertype='IPv6',id=3715c374-3142-4b78-bb44-8d025e7fb38a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad38d71b8bad4b6ab371191320ea8faf',protocol=,remote_address_group_id=,remote_group_id=2f204426-eae7-4ac6-a3cc-b535336c53ca,remote_ip_prefix=,revision_number=0,security_group_id=2f204426-eae7-4ac6-a3cc-b535336c53ca,updated_at=2022-10-16T00:59:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:14.507949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3715c374-3142-4b78-bb44-8d025e7fb38a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.508277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.508965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:14Z,description=,direction='ingress',ethertype='IPv4',id=eb3ed364-150f-4150-9bef-139280ea68e3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ad38d71b8bad4b6ab371191320ea8faf',protocol=,remote_address_group_id=,remote_group_id=2f204426-eae7-4ac6-a3cc-b535336c53ca,remote_ip_prefix=,revision_number=0,security_group_id=2f204426-eae7-4ac6-a3cc-b535336c53ca,updated_at=2022-10-16T00:59:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:14.509318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (eb3ed364-150f-4150-9bef-139280ea68e3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.509675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-07b5fc72-6788-4fed-aa73-bf49f53c9f6a admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.639144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Resource SecurityGroup deleted: 2f204426-eae7-4ac6-a3cc-b535336c53ca {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.639924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (2f204426-eae7-4ac6-a3cc-b535336c53ca), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.640631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2f204426-eae7-4ac6-a3cc-b535336c53ca',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:14.655357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2f204426-eae7-4ac6-a3cc-b535336c53ca',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:14.655864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Resource SecurityGroupRule deleted: 294963f2-17ba-416b-a8f6-3e73817742c5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.656233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (294963f2-17ba-416b-a8f6-3e73817742c5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.656742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.657291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Resource SecurityGroupRule deleted: 34aaa0e5-0110-461f-b5bb-2e088b6eed94 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.667964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (34aaa0e5-0110-461f-b5bb-2e088b6eed94), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.668323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.668736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Resource SecurityGroupRule deleted: 3715c374-3142-4b78-bb44-8d025e7fb38a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.669271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3715c374-3142-4b78-bb44-8d025e7fb38a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.669769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:14.670290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Resource SecurityGroupRule deleted: eb3ed364-150f-4150-9bef-139280ea68e3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:14.670781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (eb3ed364-150f-4150-9bef-139280ea68e3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:14.671271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddf833e4-8bdc-4256-a722-ff413895996e admin admin] Security group rule updated ['2f204426-eae7-4ac6-a3cc-b535336c53ca'] Oct 16 00:59:15.077292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:294 started Oct 16 00:59:15.080220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416da2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=723000000,duration_sec=621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:15.080827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:15.081190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:15.491057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:15Z,description='Default security group',id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,is_default=True,name='default',project_id='04cbd2422036437d960b91015dafd7c6',revision_number=1,rules=[SecurityGroupRule(2245e378-9c1b-4ffe-88b2-36aeb5aa7c12),SecurityGroupRule(cae5b3c6-022a-4c24-9325-fbcc3265baf1),SecurityGroupRule(e6561527-fa13-4f9d-bb53-61fa2146628e),SecurityGroupRule(f38bb490-75fd-4b69-9e1e-3a319039cd73)],shared=False,stateful=True,updated_at=2022-10-16T00:59:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:15.491431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (0a83eb61-bd03-481c-8687-ffd3d16f7e32), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.492281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:15Z,description=,direction='ingress',ethertype='IPv4',id=2245e378-9c1b-4ffe-88b2-36aeb5aa7c12,normalized_cidr=None,port_range_max=,port_range_min=,project_id='04cbd2422036437d960b91015dafd7c6',protocol=,remote_address_group_id=,remote_group_id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,remote_ip_prefix=,revision_number=0,security_group_id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,updated_at=2022-10-16T00:59:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:15.492658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2245e378-9c1b-4ffe-88b2-36aeb5aa7c12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.493006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.493770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:15Z,description=,direction='ingress',ethertype='IPv6',id=cae5b3c6-022a-4c24-9325-fbcc3265baf1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='04cbd2422036437d960b91015dafd7c6',protocol=,remote_address_group_id=,remote_group_id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,remote_ip_prefix=,revision_number=0,security_group_id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,updated_at=2022-10-16T00:59:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:15.494121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (cae5b3c6-022a-4c24-9325-fbcc3265baf1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.494706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.495362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:15Z,description=,direction='egress',ethertype='IPv4',id=e6561527-fa13-4f9d-bb53-61fa2146628e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='04cbd2422036437d960b91015dafd7c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,updated_at=2022-10-16T00:59:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:15.495729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e6561527-fa13-4f9d-bb53-61fa2146628e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.496065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.496737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:15Z,description=,direction='egress',ethertype='IPv6',id=f38bb490-75fd-4b69-9e1e-3a319039cd73,normalized_cidr=None,port_range_max=,port_range_min=,project_id='04cbd2422036437d960b91015dafd7c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a83eb61-bd03-481c-8687-ffd3d16f7e32,updated_at=2022-10-16T00:59:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:15.497100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f38bb490-75fd-4b69-9e1e-3a319039cd73), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.497437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-da0cc4d2-a530-4bce-8234-237062212789 admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.684862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Resource SecurityGroup deleted: 0a83eb61-bd03-481c-8687-ffd3d16f7e32 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:15.685690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (0a83eb61-bd03-481c-8687-ffd3d16f7e32), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.686013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0a83eb61-bd03-481c-8687-ffd3d16f7e32',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:15.700329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0a83eb61-bd03-481c-8687-ffd3d16f7e32',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:15.701407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Resource SecurityGroupRule deleted: 2245e378-9c1b-4ffe-88b2-36aeb5aa7c12 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:15.701877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2245e378-9c1b-4ffe-88b2-36aeb5aa7c12), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.702304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.702973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Resource SecurityGroupRule deleted: cae5b3c6-022a-4c24-9325-fbcc3265baf1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:15.703620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (cae5b3c6-022a-4c24-9325-fbcc3265baf1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.704074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.704594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Resource SecurityGroupRule deleted: e6561527-fa13-4f9d-bb53-61fa2146628e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:15.705113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e6561527-fa13-4f9d-bb53-61fa2146628e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.705669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:15.706259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Resource SecurityGroupRule deleted: f38bb490-75fd-4b69-9e1e-3a319039cd73 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:15.707021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f38bb490-75fd-4b69-9e1e-3a319039cd73), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:15.707330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4ebb97fd-e551-43c5-bdd7-7044e3d7734d admin admin] Security group rule updated ['0a83eb61-bd03-481c-8687-ffd3d16f7e32'] Oct 16 00:59:17.078685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:295 started Oct 16 00:59:17.081961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416da4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=724000000,duration_sec=623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:17.082802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:17.083005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:19.080160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:296 started Oct 16 00:59:19.082794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416da6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=726000000,duration_sec=625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:19.083423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:19.083785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:21.080874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:297 started Oct 16 00:59:21.083387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416da8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=726000000,duration_sec=627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:21.083956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:21.084308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:23.081934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:298 started Oct 16 00:59:23.084390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416daa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=727000000,duration_sec=629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:23.084963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:23.085350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:25.083055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:299 started Oct 16 00:59:25.085779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=728000000,duration_sec=631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:25.086373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:25.086762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:27.083637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:300 started Oct 16 00:59:27.086224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=729000000,duration_sec=633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:27.086918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:27.087408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:28.012242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:27Z,description='Default security group',id=f0b030f9-2462-430c-8422-2d36bbca216b,is_default=True,name='default',project_id='f9e95af24f5949d5ace05479c100dcd2',revision_number=1,rules=[SecurityGroupRule(3e29f918-f57f-4a5d-91a4-96f32df693b5),SecurityGroupRule(43028018-e901-4783-b310-5a0077c985da),SecurityGroupRule(b963d96b-c77e-40c2-ac6f-2939d053e420),SecurityGroupRule(be52f7ed-8b75-4b73-97f8-cb76b74c3096)],shared=False,stateful=True,updated_at=2022-10-16T00:59:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:28.012624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (f0b030f9-2462-430c-8422-2d36bbca216b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.013256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:27Z,description=,direction='ingress',ethertype='IPv4',id=3e29f918-f57f-4a5d-91a4-96f32df693b5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9e95af24f5949d5ace05479c100dcd2',protocol=,remote_address_group_id=,remote_group_id=f0b030f9-2462-430c-8422-2d36bbca216b,remote_ip_prefix=,revision_number=0,security_group_id=f0b030f9-2462-430c-8422-2d36bbca216b,updated_at=2022-10-16T00:59:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:28.013610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3e29f918-f57f-4a5d-91a4-96f32df693b5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.013945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.014622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:27Z,description=,direction='egress',ethertype='IPv6',id=43028018-e901-4783-b310-5a0077c985da,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9e95af24f5949d5ace05479c100dcd2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0b030f9-2462-430c-8422-2d36bbca216b,updated_at=2022-10-16T00:59:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:28.014996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (43028018-e901-4783-b310-5a0077c985da), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.015510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.016181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:27Z,description=,direction='egress',ethertype='IPv4',id=b963d96b-c77e-40c2-ac6f-2939d053e420,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9e95af24f5949d5ace05479c100dcd2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0b030f9-2462-430c-8422-2d36bbca216b,updated_at=2022-10-16T00:59:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:28.016485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b963d96b-c77e-40c2-ac6f-2939d053e420), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.016809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.017462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:27Z,description=,direction='ingress',ethertype='IPv6',id=be52f7ed-8b75-4b73-97f8-cb76b74c3096,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9e95af24f5949d5ace05479c100dcd2',protocol=,remote_address_group_id=,remote_group_id=f0b030f9-2462-430c-8422-2d36bbca216b,remote_ip_prefix=,revision_number=0,security_group_id=f0b030f9-2462-430c-8422-2d36bbca216b,updated_at=2022-10-16T00:59:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:28.017810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (be52f7ed-8b75-4b73-97f8-cb76b74c3096), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.018144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b6b79de-a128-4bb0-8d21-5c0d03eea82e admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.178557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Resource SecurityGroup deleted: f0b030f9-2462-430c-8422-2d36bbca216b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:28.180058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (f0b030f9-2462-430c-8422-2d36bbca216b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.180745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f0b030f9-2462-430c-8422-2d36bbca216b',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:28.200262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f0b030f9-2462-430c-8422-2d36bbca216b',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:28.201131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Resource SecurityGroupRule deleted: 3e29f918-f57f-4a5d-91a4-96f32df693b5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:28.202164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3e29f918-f57f-4a5d-91a4-96f32df693b5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.202604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.203499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Resource SecurityGroupRule deleted: 43028018-e901-4783-b310-5a0077c985da {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:28.204055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (43028018-e901-4783-b310-5a0077c985da), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.204906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.205849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Resource SecurityGroupRule deleted: b963d96b-c77e-40c2-ac6f-2939d053e420 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:28.206213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b963d96b-c77e-40c2-ac6f-2939d053e420), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.206553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:28.207095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Resource SecurityGroupRule deleted: be52f7ed-8b75-4b73-97f8-cb76b74c3096 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:28.207448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (be52f7ed-8b75-4b73-97f8-cb76b74c3096), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:28.207806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5e2466d9-4f39-4d71-9ec7-335135ed7722 admin admin] Security group rule updated ['f0b030f9-2462-430c-8422-2d36bbca216b'] Oct 16 00:59:29.084805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:301 started Oct 16 00:59:29.087379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416db0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=730000000,duration_sec=635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:29.088574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:29.089359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:59:29.617816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:29Z,description='Default security group',id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,is_default=True,name='default',project_id='1a03a779af054a91b2672544374c6ef1',revision_number=1,rules=[SecurityGroupRule(19999b94-8b50-4ad0-acfd-ee0eae5d7aac),SecurityGroupRule(6c99de7f-0f4d-44ec-b1d6-756e60cbd934),SecurityGroupRule(7b2b1f57-a1e5-4277-9a26-820f7b80c318),SecurityGroupRule(7f070114-d4e5-4d9d-ab35-04b0b619469c)],shared=False,stateful=True,updated_at=2022-10-16T00:59:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:29.618447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (5bf0d88e-82da-4259-8fe0-dbed6fbdffd2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.619471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:29Z,description=,direction='ingress',ethertype='IPv4',id=19999b94-8b50-4ad0-acfd-ee0eae5d7aac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a03a779af054a91b2672544374c6ef1',protocol=,remote_address_group_id=,remote_group_id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,remote_ip_prefix=,revision_number=0,security_group_id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,updated_at=2022-10-16T00:59:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:29.619848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (19999b94-8b50-4ad0-acfd-ee0eae5d7aac), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.620195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.620899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:29Z,description=,direction='egress',ethertype='IPv6',id=6c99de7f-0f4d-44ec-b1d6-756e60cbd934,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a03a779af054a91b2672544374c6ef1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,updated_at=2022-10-16T00:59:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:29.621610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6c99de7f-0f4d-44ec-b1d6-756e60cbd934), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.621942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.622645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:29Z,description=,direction='ingress',ethertype='IPv6',id=7b2b1f57-a1e5-4277-9a26-820f7b80c318,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a03a779af054a91b2672544374c6ef1',protocol=,remote_address_group_id=,remote_group_id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,remote_ip_prefix=,revision_number=0,security_group_id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,updated_at=2022-10-16T00:59:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:29.623029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7b2b1f57-a1e5-4277-9a26-820f7b80c318), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.623364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.624024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:29Z,description=,direction='egress',ethertype='IPv4',id=7f070114-d4e5-4d9d-ab35-04b0b619469c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1a03a779af054a91b2672544374c6ef1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5bf0d88e-82da-4259-8fe0-dbed6fbdffd2,updated_at=2022-10-16T00:59:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:29.624379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7f070114-d4e5-4d9d-ab35-04b0b619469c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.624712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9cfe0bd3-f81b-42d2-a112-fd70a4c1e441 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.755214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Resource SecurityGroup deleted: 5bf0d88e-82da-4259-8fe0-dbed6fbdffd2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:29.755920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (5bf0d88e-82da-4259-8fe0-dbed6fbdffd2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.756635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5bf0d88e-82da-4259-8fe0-dbed6fbdffd2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:29.772802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5bf0d88e-82da-4259-8fe0-dbed6fbdffd2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:29.773254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Resource SecurityGroupRule deleted: 19999b94-8b50-4ad0-acfd-ee0eae5d7aac {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:29.773741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (19999b94-8b50-4ad0-acfd-ee0eae5d7aac), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.774027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.774418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Resource SecurityGroupRule deleted: 6c99de7f-0f4d-44ec-b1d6-756e60cbd934 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:29.774773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6c99de7f-0f4d-44ec-b1d6-756e60cbd934), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.775121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.775499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Resource SecurityGroupRule deleted: 7b2b1f57-a1e5-4277-9a26-820f7b80c318 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:29.775841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7b2b1f57-a1e5-4277-9a26-820f7b80c318), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.776176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:29.776545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Resource SecurityGroupRule deleted: 7f070114-d4e5-4d9d-ab35-04b0b619469c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:29.776890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7f070114-d4e5-4d9d-ab35-04b0b619469c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:29.777204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-feff6baa-1acc-4363-9f27-fe9e5ba01b38 admin admin] Security group rule updated ['5bf0d88e-82da-4259-8fe0-dbed6fbdffd2'] Oct 16 00:59:30.718761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:30Z,description='Default security group',id=fb55519e-722d-49f4-9a24-42b82b48aa56,is_default=True,name='default',project_id='92116166994646b39ec7a4c23e8cedc4',revision_number=1,rules=[SecurityGroupRule(38f0a2a2-1263-4d1a-8ab5-9a26aa9e8dde),SecurityGroupRule(390ae929-a96b-4292-b633-6bfef094e67a),SecurityGroupRule(b06b5c99-0512-4397-bf1a-cafd3f96c418),SecurityGroupRule(c3ab0159-2ef2-4e60-8dbd-c7558b1277df)],shared=False,stateful=True,updated_at=2022-10-16T00:59:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:30.719437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (fb55519e-722d-49f4-9a24-42b82b48aa56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:30.719886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:30Z,description=,direction='egress',ethertype='IPv4',id=38f0a2a2-1263-4d1a-8ab5-9a26aa9e8dde,normalized_cidr=None,port_range_max=,port_range_min=,project_id='92116166994646b39ec7a4c23e8cedc4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb55519e-722d-49f4-9a24-42b82b48aa56,updated_at=2022-10-16T00:59:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:30.720243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (38f0a2a2-1263-4d1a-8ab5-9a26aa9e8dde), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:30.720591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 00:59:30.721290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:30Z,description=,direction='ingress',ethertype='IPv4',id=390ae929-a96b-4292-b633-6bfef094e67a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='92116166994646b39ec7a4c23e8cedc4',protocol=,remote_address_group_id=,remote_group_id=fb55519e-722d-49f4-9a24-42b82b48aa56,remote_ip_prefix=,revision_number=0,security_group_id=fb55519e-722d-49f4-9a24-42b82b48aa56,updated_at=2022-10-16T00:59:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:30.721685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (390ae929-a96b-4292-b633-6bfef094e67a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:30.722024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 00:59:30.722690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:30Z,description=,direction='egress',ethertype='IPv6',id=b06b5c99-0512-4397-bf1a-cafd3f96c418,normalized_cidr=None,port_range_max=,port_range_min=,project_id='92116166994646b39ec7a4c23e8cedc4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb55519e-722d-49f4-9a24-42b82b48aa56,updated_at=2022-10-16T00:59:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:30.723081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b06b5c99-0512-4397-bf1a-cafd3f96c418), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:30.723416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 00:59:30.724086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:30Z,description=,direction='ingress',ethertype='IPv6',id=c3ab0159-2ef2-4e60-8dbd-c7558b1277df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='92116166994646b39ec7a4c23e8cedc4',protocol=,remote_address_group_id=,remote_group_id=fb55519e-722d-49f4-9a24-42b82b48aa56,remote_ip_prefix=,revision_number=0,security_group_id=fb55519e-722d-49f4-9a24-42b82b48aa56,updated_at=2022-10-16T00:59:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:30.724448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c3ab0159-2ef2-4e60-8dbd-c7558b1277df), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:30.724784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 00:59:30.860596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:59:30Z,description='',dns_domain=None,id=2990507f-5171-4eb8-ae44-3866cf4c43a9,mtu=1500,name='tempest-VolumesActionsTest-1260519154-network',project_id='92116166994646b39ec7a4c23e8cedc4',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(2990507f-5171-4eb8-ae44-3866cf4c43a9),segments=[NetworkSegment(4d693cf3-b43f-41e8-8a4a-dae4c48f093a)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:59:30Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:30.861094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (2990507f-5171-4eb8-ae44-3866cf4c43a9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-4b141666-950f-411b-86c4-7336b51d64b9 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2990507f-5171-4eb8-ae44-3866cf4c43a9 with segmentation id not found. Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:59:30.940927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:59:30.941984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:59:30.941984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:59:30.941984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:59:30.941984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 2990507f-5171-4eb8-ae44-3866cf4c43a9 with segmentation id not found. Oct 16 00:59:30.941984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:59:31.086028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:302 started Oct 16 00:59:31.089204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416db2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=732000000,duration_sec=637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:31.090251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:31.090251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:31.143239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f19c2d21-15b2-4fb9-bca1-830042e1b2e0 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e8a06b3c-199f-4434-9f1d-970f812e5227)],cidr=172.20.0.0/28,created_at=2022-10-16T00:59:30Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=984308e5-babb-4c21-813e-335d2229fcf9,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1260519154-subnet',network_id=2990507f-5171-4eb8-ae44-3866cf4c43a9,project_id='92116166994646b39ec7a4c23e8cedc4',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:59:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:31.144194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f19c2d21-15b2-4fb9-bca1-830042e1b2e0 admin admin] Publish callbacks [] for Subnet (984308e5-babb-4c21-813e-335d2229fcf9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:33.088019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:303 started Oct 16 00:59:33.090621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416db4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=734000000,duration_sec=639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:33.091239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:33.091606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 00:59:34.328129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:34Z,description='tempest-description--526304834',id=eb457691-a9eb-4082-a592-2cdc7a5714ed,is_default=False,name='tempest-securitygroup--874780765',project_id='fb3c758e27684dcd9265e2d60036d80b',revision_number=1,rules=[SecurityGroupRule(84405510-ca07-4d81-a8f3-99ba20fc8bb3),SecurityGroupRule(8f5c372e-a39d-4dcd-83b6-84abe1754704)],shared=False,stateful=True,updated_at=2022-10-16T00:59:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:34.329822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (eb457691-a9eb-4082-a592-2cdc7a5714ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:34.330630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:34Z,description=,direction='egress',ethertype='IPv6',id=84405510-ca07-4d81-a8f3-99ba20fc8bb3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eb457691-a9eb-4082-a592-2cdc7a5714ed,updated_at=2022-10-16T00:59:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:34.331202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (84405510-ca07-4d81-a8f3-99ba20fc8bb3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:34.331783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 00:59:34.332761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:34Z,description=,direction='egress',ethertype='IPv4',id=8f5c372e-a39d-4dcd-83b6-84abe1754704,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eb457691-a9eb-4082-a592-2cdc7a5714ed,updated_at=2022-10-16T00:59:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:34.333294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8f5c372e-a39d-4dcd-83b6-84abe1754704), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:34.333786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a7a14939-258a-4ac2-96e9-48542c28a798 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 00:59:34.441442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-09c41ceb-cf4c-4074-a5bc-93e9eb7d0e83 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:34Z,description='',direction='ingress',ethertype='IPv4',id=996714b7-8bde-4d1a-82d6-8f59cb06fb82,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eb457691-a9eb-4082-a592-2cdc7a5714ed,updated_at=2022-10-16T00:59:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:34.441840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-09c41ceb-cf4c-4074-a5bc-93e9eb7d0e83 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (996714b7-8bde-4d1a-82d6-8f59cb06fb82), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:34.444960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-09c41ceb-cf4c-4074-a5bc-93e9eb7d0e83 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 00:59:34.585800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3a1f435-c9db-4160-bc7f-e393111bcee3 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:34Z,description='',direction='ingress',ethertype='IPv4',id=951d2955-88ef-493e-9914-da6a4e21ce44,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eb457691-a9eb-4082-a592-2cdc7a5714ed,updated_at=2022-10-16T00:59:34Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:34.586157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3a1f435-c9db-4160-bc7f-e393111bcee3 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (951d2955-88ef-493e-9914-da6a4e21ce44), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:34.587037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c3a1f435-c9db-4160-bc7f-e393111bcee3 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 00:59:35.088627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:304 started Oct 16 00:59:35.093353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416db6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=735000000,duration_sec=641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:35.093353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:35.093636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 00:59:35.501882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9563b451-0356-4488-8437-8fd16819a6b4 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:34Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b403988f-1d9b-4382-a370-00185d7b547d,mac_address=fa:16:3e:84:84:8b,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b403988f-1d9b-4382-a370-00185d7b547d),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T00:59:35Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:35.502580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9563b451-0356-4488-8437-8fd16819a6b4 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b403988f-1d9b-4382-a370-00185d7b547d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:35.846912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9563b451-0356-4488-8437-8fd16819a6b4 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port b403988f-1d9b-4382-a370-00185d7b547d updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '9c658e7b-2d21-4e63-9a85-67f51c8a8e41'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:35.847301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9563b451-0356-4488-8437-8fd16819a6b4 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b403988f-1d9b-4382-a370-00185d7b547d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:37.090112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:305 started Oct 16 00:59:37.093413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416db8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=736000000,duration_sec=643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:37.094292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:37.094934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:305 - starting polling. Elapsed:0.005 Oct 16 00:59:37.097684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:37.101101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:305 - port information retrieved. Elapsed:0.011 Oct 16 00:59:37.102810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 00:59:38.509047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dd08a75-5805-435e-9436-4811dc702f61 tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:37Z,data_plane_status=None,description='',device_id='13c3eeb0-533f-45a8-ba39-af5ff71addee',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d54d07bd-690c-4b92-9057-f975e6160581,mac_address=fa:16:3e:e6:8b:b2,name='',network_id=2990507f-5171-4eb8-ae44-3866cf4c43a9,numa_affinity_policy=,project_id='92116166994646b39ec7a4c23e8cedc4',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d54d07bd-690c-4b92-9057-f975e6160581),security_group_ids=set([fb55519e-722d-49f4-9a24-42b82b48aa56]),status='DOWN',updated_at=2022-10-16T00:59:37Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:38.509670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dd08a75-5805-435e-9436-4811dc702f61 tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d54d07bd-690c-4b92-9057-f975e6160581), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:38.509923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dd08a75-5805-435e-9436-4811dc702f61 tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Security group member updated {'fb55519e-722d-49f4-9a24-42b82b48aa56'} Oct 16 00:59:39.034956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:38Z,description='Default security group',id=c4145843-6421-45ed-8f25-5f93f8201f7f,is_default=True,name='default',project_id='c1d5006e67c24fdfb26bcfec851701d2',revision_number=1,rules=[SecurityGroupRule(8643cc03-2b4e-4935-ad8c-74f8e5e08664),SecurityGroupRule(89f62983-914a-48a6-96fe-1d61283c9c93),SecurityGroupRule(98a43083-0f0d-4775-89cc-e2bd5b4ea521),SecurityGroupRule(ef1da433-f777-4d67-a62e-6c8522e0744c)],shared=False,stateful=True,updated_at=2022-10-16T00:59:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:39.035086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (c4145843-6421-45ed-8f25-5f93f8201f7f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.035715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:38Z,description=,direction='ingress',ethertype='IPv4',id=8643cc03-2b4e-4935-ad8c-74f8e5e08664,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1d5006e67c24fdfb26bcfec851701d2',protocol=,remote_address_group_id=,remote_group_id=c4145843-6421-45ed-8f25-5f93f8201f7f,remote_ip_prefix=,revision_number=0,security_group_id=c4145843-6421-45ed-8f25-5f93f8201f7f,updated_at=2022-10-16T00:59:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:39.036356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8643cc03-2b4e-4935-ad8c-74f8e5e08664), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.036791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.037624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:38Z,description=,direction='ingress',ethertype='IPv6',id=89f62983-914a-48a6-96fe-1d61283c9c93,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1d5006e67c24fdfb26bcfec851701d2',protocol=,remote_address_group_id=,remote_group_id=c4145843-6421-45ed-8f25-5f93f8201f7f,remote_ip_prefix=,revision_number=0,security_group_id=c4145843-6421-45ed-8f25-5f93f8201f7f,updated_at=2022-10-16T00:59:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:39.038165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (89f62983-914a-48a6-96fe-1d61283c9c93), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.038653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.039357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:38Z,description=,direction='egress',ethertype='IPv6',id=98a43083-0f0d-4775-89cc-e2bd5b4ea521,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1d5006e67c24fdfb26bcfec851701d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4145843-6421-45ed-8f25-5f93f8201f7f,updated_at=2022-10-16T00:59:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:39.039741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (98a43083-0f0d-4775-89cc-e2bd5b4ea521), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.040129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.040799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:38Z,description=,direction='egress',ethertype='IPv4',id=ef1da433-f777-4d67-a62e-6c8522e0744c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1d5006e67c24fdfb26bcfec851701d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c4145843-6421-45ed-8f25-5f93f8201f7f,updated_at=2022-10-16T00:59:38Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:39.041164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ef1da433-f777-4d67-a62e-6c8522e0744c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.041838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b6a09933-8bab-4490-b30c-789a7260d243 admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.092543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:306 started Oct 16 00:59:39.096057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=739000000,duration_sec=645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:39.096739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:39.097548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:306 - starting polling. Elapsed:0.005 Oct 16 00:59:39.099768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.102397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:306 - port information retrieved. Elapsed:0.010 Oct 16 00:59:39.102735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 00:59:39.454436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Resource SecurityGroup deleted: c4145843-6421-45ed-8f25-5f93f8201f7f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:39.454823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (c4145843-6421-45ed-8f25-5f93f8201f7f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.455684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c4145843-6421-45ed-8f25-5f93f8201f7f',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:39.470077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c4145843-6421-45ed-8f25-5f93f8201f7f',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:39.470562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Resource SecurityGroupRule deleted: 8643cc03-2b4e-4935-ad8c-74f8e5e08664 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:39.471053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8643cc03-2b4e-4935-ad8c-74f8e5e08664), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.471591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.471996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Resource SecurityGroupRule deleted: 89f62983-914a-48a6-96fe-1d61283c9c93 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:39.472348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (89f62983-914a-48a6-96fe-1d61283c9c93), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.472692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.473671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Resource SecurityGroupRule deleted: 98a43083-0f0d-4775-89cc-e2bd5b4ea521 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:39.474028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (98a43083-0f0d-4775-89cc-e2bd5b4ea521), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.474370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:39.474931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Resource SecurityGroupRule deleted: ef1da433-f777-4d67-a62e-6c8522e0744c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:39.475267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ef1da433-f777-4d67-a62e-6c8522e0744c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:39.475602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9a6ae6a0-cec7-4aad-a3ea-37bf340d45ca admin admin] Security group rule updated ['c4145843-6421-45ed-8f25-5f93f8201f7f'] Oct 16 00:59:40.528725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5743e45a-c627-42a6-a6fa-06acfa6ca870 service neutron] Resource Port d54d07bd-690c-4b92-9057-f975e6160581 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=d54d07bd-690c-4b92-9057-f975e6160581,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=d54d07bd-690c-4b92-9057-f975e6160581,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:40.530451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5743e45a-c627-42a6-a6fa-06acfa6ca870 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d54d07bd-690c-4b92-9057-f975e6160581), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.638843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:40Z,description='Default security group',id=af673206-894a-4fd9-ac90-dfb428a89c9e,is_default=True,name='default',project_id='411d2dda80534b15946c38b816defaa1',revision_number=1,rules=[SecurityGroupRule(197a2035-03a4-418b-bab8-d4f4c0e8ea3e),SecurityGroupRule(23366150-101f-45c4-ae19-1ecb6b4b431a),SecurityGroupRule(77afe235-4ae7-461d-ad68-e300d3335540),SecurityGroupRule(de2b1b84-b461-456d-a85d-9461fc054d26)],shared=False,stateful=True,updated_at=2022-10-16T00:59:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:40.639713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (af673206-894a-4fd9-ac90-dfb428a89c9e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.640630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:40Z,description=,direction='ingress',ethertype='IPv4',id=197a2035-03a4-418b-bab8-d4f4c0e8ea3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='411d2dda80534b15946c38b816defaa1',protocol=,remote_address_group_id=,remote_group_id=af673206-894a-4fd9-ac90-dfb428a89c9e,remote_ip_prefix=,revision_number=0,security_group_id=af673206-894a-4fd9-ac90-dfb428a89c9e,updated_at=2022-10-16T00:59:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:40.641266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (197a2035-03a4-418b-bab8-d4f4c0e8ea3e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.641846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.643130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:40Z,description=,direction='ingress',ethertype='IPv6',id=23366150-101f-45c4-ae19-1ecb6b4b431a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='411d2dda80534b15946c38b816defaa1',protocol=,remote_address_group_id=,remote_group_id=af673206-894a-4fd9-ac90-dfb428a89c9e,remote_ip_prefix=,revision_number=0,security_group_id=af673206-894a-4fd9-ac90-dfb428a89c9e,updated_at=2022-10-16T00:59:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:40.643832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (23366150-101f-45c4-ae19-1ecb6b4b431a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.644367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.645370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:40Z,description=,direction='egress',ethertype='IPv4',id=77afe235-4ae7-461d-ad68-e300d3335540,normalized_cidr=None,port_range_max=,port_range_min=,project_id='411d2dda80534b15946c38b816defaa1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=af673206-894a-4fd9-ac90-dfb428a89c9e,updated_at=2022-10-16T00:59:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:40.645784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (77afe235-4ae7-461d-ad68-e300d3335540), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.646329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.647214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:40Z,description=,direction='egress',ethertype='IPv6',id=de2b1b84-b461-456d-a85d-9461fc054d26,normalized_cidr=None,port_range_max=,port_range_min=,project_id='411d2dda80534b15946c38b816defaa1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=af673206-894a-4fd9-ac90-dfb428a89c9e,updated_at=2022-10-16T00:59:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:40.647815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (de2b1b84-b461-456d-a85d-9461fc054d26), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.648393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-46112bcf-cfea-4efd-8332-5168b1fd5e30 admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.872668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Resource SecurityGroup deleted: af673206-894a-4fd9-ac90-dfb428a89c9e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:40.873411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (af673206-894a-4fd9-ac90-dfb428a89c9e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.874118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('af673206-894a-4fd9-ac90-dfb428a89c9e',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 00:59:40.888631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('af673206-894a-4fd9-ac90-dfb428a89c9e',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 00:59:40.889179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Resource SecurityGroupRule deleted: 197a2035-03a4-418b-bab8-d4f4c0e8ea3e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:40.889555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (197a2035-03a4-418b-bab8-d4f4c0e8ea3e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.889955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.890368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Resource SecurityGroupRule deleted: 23366150-101f-45c4-ae19-1ecb6b4b431a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:40.890703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (23366150-101f-45c4-ae19-1ecb6b4b431a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.891106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.891480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Resource SecurityGroupRule deleted: 77afe235-4ae7-461d-ad68-e300d3335540 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:40.891885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (77afe235-4ae7-461d-ad68-e300d3335540), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.892189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.892557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Resource SecurityGroupRule deleted: de2b1b84-b461-456d-a85d-9461fc054d26 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:40.892967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (de2b1b84-b461-456d-a85d-9461fc054d26), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.893293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cd73f9d8-aed2-4ad6-9c40-fbed5107683c admin admin] Security group rule updated ['af673206-894a-4fd9-ac90-dfb428a89c9e'] Oct 16 00:59:40.975346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a10e8a80-2be0-487d-be4d-681b148b5b22 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:40Z,data_plane_status=None,description='',device_id='18a404c6-15f6-40d3-bfbc-df301770a4fe',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4827324a-a969-452f-85b3-109a32799305,mac_address=fa:16:3e:95:9c:a9,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4827324a-a969-452f-85b3-109a32799305),security_group_ids=set([eb457691-a9eb-4082-a592-2cdc7a5714ed]),status='DOWN',updated_at=2022-10-16T00:59:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:40.975965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a10e8a80-2be0-487d-be4d-681b148b5b22 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4827324a-a969-452f-85b3-109a32799305), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:40.977316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a10e8a80-2be0-487d-be4d-681b148b5b22 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'eb457691-a9eb-4082-a592-2cdc7a5714ed'} Oct 16 00:59:41.094045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:307 started Oct 16 00:59:41.098082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=740000000,duration_sec=647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:41.099061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:41.099631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:307 - starting polling. Elapsed:0.006 Oct 16 00:59:41.105595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:41.109608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:307 - port information retrieved. Elapsed:0.016 Oct 16 00:59:41.110518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 16 00:59:41.165498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5743e45a-c627-42a6-a6fa-06acfa6ca870 service neutron] Resource Port d54d07bd-690c-4b92-9057-f975e6160581 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=d54d07bd-690c-4b92-9057-f975e6160581,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=d54d07bd-690c-4b92-9057-f975e6160581,segment=NetworkSegment(4d693cf3-b43f-41e8-8a4a-dae4c48f093a),segment_id=4d693cf3-b43f-41e8-8a4a-dae4c48f093a)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=d54d07bd-690c-4b92-9057-f975e6160581,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:41.165962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5743e45a-c627-42a6-a6fa-06acfa6ca870 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d54d07bd-690c-4b92-9057-f975e6160581), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.290350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b3231fd0-2b6c-4352-8340-d4b8ff1e76c5 service neutron] Resource Port 4827324a-a969-452f-85b3-109a32799305 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=4827324a-a969-452f-85b3-109a32799305,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=4827324a-a969-452f-85b3-109a32799305,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:42.291023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b3231fd0-2b6c-4352-8340-d4b8ff1e76c5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4827324a-a969-452f-85b3-109a32799305), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.464915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:42Z,description='Default security group',id=8fe3bf74-e019-4454-9cfb-63e09082d849,is_default=True,name='default',project_id='cb1743385ea14cc39244c83e8fc88e7e',revision_number=1,rules=[SecurityGroupRule(002adbfb-b43e-4ace-b6c8-ab7a228e489a),SecurityGroupRule(0a3df241-6bc6-4b12-aa56-062a314d77a6),SecurityGroupRule(af85e82a-49a7-4419-99c4-1a3caf05c50b),SecurityGroupRule(b22d0823-0fa5-4507-8e96-f68d40e9f149)],shared=False,stateful=True,updated_at=2022-10-16T00:59:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.466064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (8fe3bf74-e019-4454-9cfb-63e09082d849), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.467472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:42Z,description=,direction='egress',ethertype='IPv4',id=002adbfb-b43e-4ace-b6c8-ab7a228e489a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8fe3bf74-e019-4454-9cfb-63e09082d849,updated_at=2022-10-16T00:59:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.467973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (002adbfb-b43e-4ace-b6c8-ab7a228e489a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.468636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 00:59:42.469386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:42Z,description=,direction='egress',ethertype='IPv6',id=0a3df241-6bc6-4b12-aa56-062a314d77a6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8fe3bf74-e019-4454-9cfb-63e09082d849,updated_at=2022-10-16T00:59:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.470065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0a3df241-6bc6-4b12-aa56-062a314d77a6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.470423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 00:59:42.471132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:42Z,description=,direction='ingress',ethertype='IPv6',id=af85e82a-49a7-4419-99c4-1a3caf05c50b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol=,remote_address_group_id=,remote_group_id=8fe3bf74-e019-4454-9cfb-63e09082d849,remote_ip_prefix=,revision_number=0,security_group_id=8fe3bf74-e019-4454-9cfb-63e09082d849,updated_at=2022-10-16T00:59:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.471794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (af85e82a-49a7-4419-99c4-1a3caf05c50b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.472172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 00:59:42.473538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:42Z,description=,direction='ingress',ethertype='IPv4',id=b22d0823-0fa5-4507-8e96-f68d40e9f149,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol=,remote_address_group_id=,remote_group_id=8fe3bf74-e019-4454-9cfb-63e09082d849,remote_ip_prefix=,revision_number=0,security_group_id=8fe3bf74-e019-4454-9cfb-63e09082d849,updated_at=2022-10-16T00:59:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.473899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b22d0823-0fa5-4507-8e96-f68d40e9f149), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.474473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 00:59:42.581543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b3231fd0-2b6c-4352-8340-d4b8ff1e76c5 service neutron] Resource Port 4827324a-a969-452f-85b3-109a32799305 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=4827324a-a969-452f-85b3-109a32799305,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4827324a-a969-452f-85b3-109a32799305,segment=NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565),segment_id=994bcd7f-d2ee-4126-bfcb-b7cd5780c565)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=4827324a-a969-452f-85b3-109a32799305,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:42.581938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b3231fd0-2b6c-4352-8340-d4b8ff1e76c5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4827324a-a969-452f-85b3-109a32799305), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.628823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:59:42Z,description='',dns_domain=None,id=67400858-429f-4052-a9a5-3012690406d5,mtu=1500,name='tempest-TestVolumeBootPattern-663501040-network',project_id='cb1743385ea14cc39244c83e8fc88e7e',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(67400858-429f-4052-a9a5-3012690406d5),segments=[NetworkSegment(e85c3ee2-f8b6-42c0-8def-930e36cc19ac)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:59:42Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.629425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (67400858-429f-4052-a9a5-3012690406d5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-15c50686-f58d-45f1-9233-24678690052f admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 67400858-429f-4052-a9a5-3012690406d5 with segmentation id not found. Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:59:42.710705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:59:42.711800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:59:42.711800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:59:42.711800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:59:42.711800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 67400858-429f-4052-a9a5-3012690406d5 with segmentation id not found. Oct 16 00:59:42.711800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:59:42.935682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-23dfb1df-d04d-4f42-a7b3-5b679b3f000f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4a8ac11f-d2c7-4208-b7df-2dac597df22b)],cidr=172.20.0.0/28,created_at=2022-10-16T00:59:42Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=85abdef7-ce07-4fe0-b80f-da308604c12a,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-663501040-subnet',network_id=67400858-429f-4052-a9a5-3012690406d5,project_id='cb1743385ea14cc39244c83e8fc88e7e',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:59:42Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:42.936063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-23dfb1df-d04d-4f42-a7b3-5b679b3f000f admin admin] Publish callbacks [] for Subnet (85abdef7-ce07-4fe0-b80f-da308604c12a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:43.095780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:308 started Oct 16 00:59:43.099289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dbe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=742000000,duration_sec=649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:43.100412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:43.100829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:308 - starting polling. Elapsed:0.005 Oct 16 00:59:43.102939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:43.108427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:308 - port information retrieved. Elapsed:0.013 Oct 16 00:59:43.108892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 00:59:43.728313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-18cdcbdd-34a3-4b78-9e70-cbb9b60cab96 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:43Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-67400858-429f-4052-a9a5-3012690406d5',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=54484db5-9b23-44a4-aeef-b1d117e40429,mac_address=fa:16:3e:a2:32:97,name='',network_id=67400858-429f-4052-a9a5-3012690406d5,numa_affinity_policy=,project_id='cb1743385ea14cc39244c83e8fc88e7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(54484db5-9b23-44a4-aeef-b1d117e40429),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:59:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:43.731176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-18cdcbdd-34a3-4b78-9e70-cbb9b60cab96 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (54484db5-9b23-44a4-aeef-b1d117e40429), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:43.965766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-18cdcbdd-34a3-4b78-9e70-cbb9b60cab96 None None] Resource Port 54484db5-9b23-44a4-aeef-b1d117e40429 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=54484db5-9b23-44a4-aeef-b1d117e40429,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=54484db5-9b23-44a4-aeef-b1d117e40429,segment=NetworkSegment(e85c3ee2-f8b6-42c0-8def-930e36cc19ac),segment_id=e85c3ee2-f8b6-42c0-8def-930e36cc19ac)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=54484db5-9b23-44a4-aeef-b1d117e40429,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:43.966319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-18cdcbdd-34a3-4b78-9e70-cbb9b60cab96 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (54484db5-9b23-44a4-aeef-b1d117e40429), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.085043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6f79d52d-ed97-441c-9527-073ff9341ea5","insert","tap54484db5-9b",["set",[]],["map",[["attached-mac","fa:16:3e:a2:32:97"],["iface-id","54484db5-9b23-44a4-aeef-b1d117e40429"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:44.115192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6f79d52d-ed97-441c-9527-073ff9341ea5","old",null,["set",[]],null],["","new","tap54484db5-9b",18,["map",[["attached-mac","fa:16:3e:a2:32:97"],["iface-id","54484db5-9b23-44a4-aeef-b1d117e40429"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:44.130063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:43Z,description='tempest-description--679726400',id=e4a83e87-e8e3-429b-8d31-804d75d095e2,is_default=False,name='tempest-securitygroup--1665824567',project_id='5462fcbfca114c8885f77f42b479b13d',revision_number=1,rules=[SecurityGroupRule(ef18c8c4-5748-4319-9612-24239e0491b4),SecurityGroupRule(f03f2dcd-d0d8-4e9d-b4b8-b712d6cf849e)],shared=False,stateful=True,updated_at=2022-10-16T00:59:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:44.130468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (e4a83e87-e8e3-429b-8d31-804d75d095e2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.131128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:43Z,description=,direction='egress',ethertype='IPv4',id=ef18c8c4-5748-4319-9612-24239e0491b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4a83e87-e8e3-429b-8d31-804d75d095e2,updated_at=2022-10-16T00:59:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:44.131535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ef18c8c4-5748-4319-9612-24239e0491b4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.132044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 00:59:44.133728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:43Z,description=,direction='egress',ethertype='IPv6',id=f03f2dcd-d0d8-4e9d-b4b8-b712d6cf849e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4a83e87-e8e3-429b-8d31-804d75d095e2,updated_at=2022-10-16T00:59:43Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:44.134717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f03f2dcd-d0d8-4e9d-b4b8-b712d6cf849e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.153083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b8c6dbd8-8755-42a7-9ead-059545c8262e tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 00:59:44.546430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-809a6786-256f-4a85-ab20-10339d229d1a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:44Z,description='',direction='ingress',ethertype='IPv4',id=c47f76a9-fa81-433a-871e-c4a2d805d50a,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='5462fcbfca114c8885f77f42b479b13d',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4a83e87-e8e3-429b-8d31-804d75d095e2,updated_at=2022-10-16T00:59:44Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:44.547244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-809a6786-256f-4a85-ab20-10339d229d1a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c47f76a9-fa81-433a-871e-c4a2d805d50a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.547848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-809a6786-256f-4a85-ab20-10339d229d1a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 00:59:44.556004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-74358dc0-7291-41cb-ab92-3897eb341b50 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:43Z,data_plane_status=None,description='',device_id='a3c357fc-2a80-4724-a0d4-f2fc5e3371c9',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,mac_address=fa:16:3e:a1:f1:bc,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4499fdb3-16a3-4c5e-94f1-07baf827edcb),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:59:44Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:44.556694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-74358dc0-7291-41cb-ab92-3897eb341b50 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4499fdb3-16a3-4c5e-94f1-07baf827edcb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.708905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-81db9bf5-70a0-4d9f-a021-8ebbdf685eab tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:44Z,description='',direction='ingress',ethertype='IPv4',id=1aff11b8-308a-4bb0-8b00-d397963cbe65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5462fcbfca114c8885f77f42b479b13d',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4a83e87-e8e3-429b-8d31-804d75d095e2,updated_at=2022-10-16T00:59:44Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:44.709312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-81db9bf5-70a0-4d9f-a021-8ebbdf685eab tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1aff11b8-308a-4bb0-8b00-d397963cbe65), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:44.709703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-81db9bf5-70a0-4d9f-a021-8ebbdf685eab tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 00:59:45.097647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:309 started Oct 16 00:59:45.100251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dc0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=743000000,duration_sec=651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:45.101062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:45.101560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:309 - starting polling. Elapsed:0.004 Oct 16 00:59:45.104311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:45.107221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:309 - port information retrieved. Elapsed:0.010 Oct 16 00:59:45.107569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': {'54484db5-9b23-44a4-aeef-b1d117e40429'}, 'removed': set(), 'updated': {'54484db5-9b23-44a4-aeef-b1d117e40429'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:59:45.108138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '54484db5-9b23-44a4-aeef-b1d117e40429', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-67400858-429f-4052-a9a5-3012690406d5', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': '54484db5-9b23-44a4-aeef-b1d117e40429', 'mac_address': 'fa:16:3e:a2:32:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:45.110805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 54484db5-9b23-44a4-aeef-b1d117e40429 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:45.111190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 54484db5-9b23-44a4-aeef-b1d117e40429 updated. Details: {'device': '54484db5-9b23-44a4-aeef-b1d117e40429', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-67400858-429f-4052-a9a5-3012690406d5', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': '54484db5-9b23-44a4-aeef-b1d117e40429', 'mac_address': 'fa:16:3e:a2:32:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:59:45.111513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 8 as local vlan for net-id=67400858-429f-4052-a9a5-3012690406d5, seg-id=351 Oct 16 00:59:45.114310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c8d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4447), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:45.117000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416dc2,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4447}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:45.118057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap54484db5-9b, col_values=(('tag', 8),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:45.118481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap54484db5-9b, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:45.119124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap54484db5-9b, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:45.124960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap54484db5-9b, col_values=(('other_config', {'net_uuid': '67400858-429f-4052-a9a5-3012690406d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '351'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:45.138112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dc4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:45.138775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:309 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.031 Oct 16 00:59:45.139321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:59:45.139630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'54484db5-9b23-44a4-aeef-b1d117e40429'} Oct 16 00:59:45.140790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:59:45.141072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:59:45.146854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:59:45.201341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2739e6-e39b-4d3a-be96-326aed7164bd]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:59:45.201989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:309 - agent port security group processed in 0.094 Oct 16 00:59:45.202755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 54484db5-9b23-44a4-aeef-b1d117e40429 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:45.585264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-57e4192e-6014-41cd-8b15-7bcaaa7b76ad None None] Resource Port 54484db5-9b23-44a4-aeef-b1d117e40429 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:45.585888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-57e4192e-6014-41cd-8b15-7bcaaa7b76ad None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (54484db5-9b23-44a4-aeef-b1d117e40429), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:45.755915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['54484db5-9b23-44a4-aeef-b1d117e40429'] and devices down [] completed. Oct 16 00:59:45.756606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:309 - ports processed. Elapsed:0.659 Oct 16 00:59:45.758267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.661 Oct 16 00:59:45.974527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c3eb7e4-4aab-4d03-ba68-2a3577666c4a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:44Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2c0e6747-ef98-4449-8da2-0b70d32a7b71,mac_address=fa:16:3e:bd:90:f4,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2c0e6747-ef98-4449-8da2-0b70d32a7b71),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T00:59:45Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:45.976964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c3eb7e4-4aab-4d03-ba68-2a3577666c4a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (2c0e6747-ef98-4449-8da2-0b70d32a7b71), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:46.117565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port d54d07bd-690c-4b92-9057-f975e6160581 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:46.118235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d54d07bd-690c-4b92-9057-f975e6160581), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:46.463152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:46.463880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:46.871170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c3eb7e4-4aab-4d03-ba68-2a3577666c4a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource Port 2c0e6747-ef98-4449-8da2-0b70d32a7b71 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a80b6386-e49a-488f-ba5d-006d9aabb10c'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:46.871612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c3eb7e4-4aab-4d03-ba68-2a3577666c4a tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (2c0e6747-ef98-4449-8da2-0b70d32a7b71), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:47.098554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:310 started Oct 16 00:59:47.103517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=745000000,duration_sec=653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:47.104939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:47.105934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:310 - starting polling. Elapsed:0.007 Oct 16 00:59:47.108794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:47.111725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:310 - port information retrieved. Elapsed:0.013 Oct 16 00:59:47.114473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': set(), 'updated': {'54484db5-9b23-44a4-aeef-b1d117e40429'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:59:47.115341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '54484db5-9b23-44a4-aeef-b1d117e40429', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-67400858-429f-4052-a9a5-3012690406d5', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': '54484db5-9b23-44a4-aeef-b1d117e40429', 'mac_address': 'fa:16:3e:a2:32:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:47.132157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 54484db5-9b23-44a4-aeef-b1d117e40429 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:47.132803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 54484db5-9b23-44a4-aeef-b1d117e40429 updated. Details: {'device': '54484db5-9b23-44a4-aeef-b1d117e40429', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-67400858-429f-4052-a9a5-3012690406d5', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': '54484db5-9b23-44a4-aeef-b1d117e40429', 'mac_address': 'fa:16:3e:a2:32:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 16 00:59:47.133652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap54484db5-9b, col_values=(('tag', 8),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:47.134082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap54484db5-9b, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:47.134473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap54484db5-9b, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:47.135327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:47.137017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap54484db5-9b, col_values=(('other_config', {'net_uuid': '67400858-429f-4052-a9a5-3012690406d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '351', 'tag': '8'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:47.137737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:47.153279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dc8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:47.153668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:310 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.039 Oct 16 00:59:47.154038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:59:47.154336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:59:47.155966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:59:47.156258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:59:47.192671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:59:47.296622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa90751-d514-47c7-8a41-833d2cfe9078]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:59:47.297477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:310 - agent port security group processed in 0.182 Oct 16 00:59:47.298373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 54484db5-9b23-44a4-aeef-b1d117e40429 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:47.635552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['54484db5-9b23-44a4-aeef-b1d117e40429'] and devices down [] completed. Oct 16 00:59:47.635956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:310 - ports processed. Elapsed:0.538 Oct 16 00:59:47.636323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.538 Oct 16 00:59:47.688443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-034c78df-e7a3-4bed-9bea-d0ca719a2d3c None None] Resource Port 4499fdb3-16a3-4c5e-94f1-07baf827edcb updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:47.689073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-034c78df-e7a3-4bed-9bea-d0ca719a2d3c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4499fdb3-16a3-4c5e-94f1-07baf827edcb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:48.085357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-034c78df-e7a3-4bed-9bea-d0ca719a2d3c None None] Resource Port 4499fdb3-16a3-4c5e-94f1-07baf827edcb updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:48.085751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-034c78df-e7a3-4bed-9bea-d0ca719a2d3c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4499fdb3-16a3-4c5e-94f1-07baf827edcb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:48.122688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3189ab2f-efc6-4da8-8686-74d4a53001b2 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:47Z,data_plane_status=None,description='',device_id='a3c357fc-2a80-4724-a0d4-f2fc5e3371c9',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d6141001-454c-4247-9f8c-c8bedfbcc602,mac_address=fa:16:3e:67:c9:31,name='',network_id=67400858-429f-4052-a9a5-3012690406d5,numa_affinity_policy=,project_id='cb1743385ea14cc39244c83e8fc88e7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d6141001-454c-4247-9f8c-c8bedfbcc602),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:59:47Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:48.123437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3189ab2f-efc6-4da8-8686-74d4a53001b2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6141001-454c-4247-9f8c-c8bedfbcc602), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:49.099589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:311 started Oct 16 00:59:49.105711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=747000000,duration_sec=655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:49.106727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:49.109203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:311 - starting polling. Elapsed:0.010 Oct 16 00:59:49.112636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:49.118222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:311 - port information retrieved. Elapsed:0.018 Oct 16 00:59:49.119048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 16 00:59:49.304386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3189ab2f-efc6-4da8-8686-74d4a53001b2 admin admin] Received resource Port update without any changes: d6141001-454c-4247-9f8c-c8bedfbcc602 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 00:59:49.453573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port d54d07bd-690c-4b92-9057-f975e6160581 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:49.453806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d54d07bd-690c-4b92-9057-f975e6160581), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:49.591039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["86318794-68e3-4f6e-9a67-47f8570ab573","insert","qg-4499fdb3-16",["set",[]],["map",[["attached-mac","fa:16:3e:a1:f1:bc"],["iface-id","4499fdb3-16a3-4c5e-94f1-07baf827edcb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:49.617031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 4827324a-a969-452f-85b3-109a32799305 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:49.617565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4827324a-a969-452f-85b3-109a32799305), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:49.622173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["86318794-68e3-4f6e-9a67-47f8570ab573","old",null,["set",[]],null],["","new","qg-4499fdb3-16",19,["map",[["attached-mac","fa:16:3e:a1:f1:bc"],["iface-id","4499fdb3-16a3-4c5e-94f1-07baf827edcb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:50.179242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:50.179967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.107180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:312 started Oct 16 00:59:51.114065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dcc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=749000000,duration_sec=657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:51.118257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:51.120145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:312 - starting polling. Elapsed:0.017 Oct 16 00:59:51.129998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.138181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:312 - port information retrieved. Elapsed:0.036 Oct 16 00:59:51.144041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': {'4499fdb3-16a3-4c5e-94f1-07baf827edcb'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:59:51.144738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'mac_address': 'fa:16:3e:a1:f1:bc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:51.147628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 4499fdb3-16a3-4c5e-94f1-07baf827edcb {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:51.147955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4499fdb3-16a3-4c5e-94f1-07baf827edcb updated. Details: {'device': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'mac_address': 'fa:16:3e:a1:f1:bc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:59:51.148945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4499fdb3-16, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:51.149365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-4499fdb3-16, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:51.149784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-4499fdb3-16, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:51.164278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4499fdb3-16, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:51.176771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dce,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:51.177184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:312 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.033 Oct 16 00:59:51.177543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:59:51.177914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'4499fdb3-16a3-4c5e-94f1-07baf827edcb'} Oct 16 00:59:51.179145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:59:51.179436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:59:51.185033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:59:51.293671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9c8e4e-c2b2-47fd-8887-5600e48a7427]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:59:51.294295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:312 - agent port security group processed in 0.150 Oct 16 00:59:51.295420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 4499fdb3-16a3-4c5e-94f1-07baf827edcb to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:51.406102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T00:59:51Z,description='Default security group',id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,is_default=True,name='default',project_id='403b173e9ff04603b1c33837dcd1ba73',revision_number=1,rules=[SecurityGroupRule(41b3c0a0-069e-46b4-b4a7-60aa318e1e74),SecurityGroupRule(627f4884-3fe2-4159-9ed0-8401a94e8d74),SecurityGroupRule(8425f475-9b79-47b5-8086-d4f9d5d854a3),SecurityGroupRule(c122298e-0bba-4314-bdf0-52d2ee66589c)],shared=False,stateful=True,updated_at=2022-10-16T00:59:51Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:51.406595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (4daccf5d-b1df-47b4-9c00-4a60f28fb466), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.407762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:51Z,description=,direction='egress',ethertype='IPv4',id=41b3c0a0-069e-46b4-b4a7-60aa318e1e74,normalized_cidr=None,port_range_max=,port_range_min=,project_id='403b173e9ff04603b1c33837dcd1ba73',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,updated_at=2022-10-16T00:59:51Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:51.408187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (41b3c0a0-069e-46b4-b4a7-60aa318e1e74), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.408654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 00:59:51.409367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:51Z,description=,direction='ingress',ethertype='IPv6',id=627f4884-3fe2-4159-9ed0-8401a94e8d74,normalized_cidr=None,port_range_max=,port_range_min=,project_id='403b173e9ff04603b1c33837dcd1ba73',protocol=,remote_address_group_id=,remote_group_id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,remote_ip_prefix=,revision_number=0,security_group_id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,updated_at=2022-10-16T00:59:51Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:51.409727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (627f4884-3fe2-4159-9ed0-8401a94e8d74), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.410066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 00:59:51.411301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:51Z,description=,direction='ingress',ethertype='IPv4',id=8425f475-9b79-47b5-8086-d4f9d5d854a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='403b173e9ff04603b1c33837dcd1ba73',protocol=,remote_address_group_id=,remote_group_id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,remote_ip_prefix=,revision_number=0,security_group_id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,updated_at=2022-10-16T00:59:51Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:51.411667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8425f475-9b79-47b5-8086-d4f9d5d854a3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.412007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 00:59:51.415907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T00:59:51Z,description=,direction='egress',ethertype='IPv6',id=c122298e-0bba-4314-bdf0-52d2ee66589c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='403b173e9ff04603b1c33837dcd1ba73',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4daccf5d-b1df-47b4-9c00-4a60f28fb466,updated_at=2022-10-16T00:59:51Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:51.416218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c122298e-0bba-4314-bdf0-52d2ee66589c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.416569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 00:59:51.823257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T00:59:51Z,description='',dns_domain=None,id=3ddf9fc6-b7ec-4894-844e-44f84b7c3b07,mtu=1500,name='tempest-TestVolumeBootPattern-669493276-network',project_id='403b173e9ff04603b1c33837dcd1ba73',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3ddf9fc6-b7ec-4894-844e-44f84b7c3b07),segments=[NetworkSegment(0942553e-2aee-4b84-ab5c-33fc9ebfbe94)],shared=False,status='ACTIVE',updated_at=2022-10-16T00:59:51Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:51.824004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (3ddf9fc6-b7ec-4894-844e-44f84b7c3b07), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:51.885728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['4499fdb3-16a3-4c5e-94f1-07baf827edcb'] and devices down [] completed. Oct 16 00:59:51.886252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:312 - ports processed. Elapsed:0.784 Oct 16 00:59:51.886779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.785 Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-a2d8cdfd-265c-4af0-95e3-203802e2cb1c admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3ddf9fc6-b7ec-4894-844e-44f84b7c3b07 with segmentation id not found. Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 00:59:52.071032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 00:59:52.071903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 00:59:52.071903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 00:59:52.071903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 00:59:52.071903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3ddf9fc6-b7ec-4894-844e-44f84b7c3b07 with segmentation id not found. Oct 16 00:59:52.071903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 00:59:52.174672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 4499fdb3-16a3-4c5e-94f1-07baf827edcb updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4499fdb3-16a3-4c5e-94f1-07baf827edcb,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:52.175373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4499fdb3-16a3-4c5e-94f1-07baf827edcb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:52.597378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 4827324a-a969-452f-85b3-109a32799305 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:52.599321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4827324a-a969-452f-85b3-109a32799305), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:52.602194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ff7e4408-950a-473c-ab7f-589b2b7d442f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(25fa8e8c-6b87-4d0b-a1a5-fd7654588fdd)],cidr=172.20.0.0/28,created_at=2022-10-16T00:59:51Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=67eb960f-e877-4e93-8af8-8f120433934d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-669493276-subnet',network_id=3ddf9fc6-b7ec-4894-844e-44f84b7c3b07,project_id='403b173e9ff04603b1c33837dcd1ba73',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T00:59:51Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:52.604838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ff7e4408-950a-473c-ab7f-589b2b7d442f admin admin] Publish callbacks [] for Subnet (67eb960f-e877-4e93-8af8-8f120433934d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:53.103888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:313 started Oct 16 00:59:53.107805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dd0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=750000000,duration_sec=659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:53.108746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:53.109125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:313 - starting polling. Elapsed:0.006 Oct 16 00:59:53.111582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:53.116851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:313 - port information retrieved. Elapsed:0.013 Oct 16 00:59:53.116851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': set(), 'updated': {'4499fdb3-16a3-4c5e-94f1-07baf827edcb'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:59:53.118517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'mac_address': 'fa:16:3e:a1:f1:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:53.126270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 4499fdb3-16a3-4c5e-94f1-07baf827edcb {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:53.126621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4499fdb3-16a3-4c5e-94f1-07baf827edcb updated. Details: {'device': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '4499fdb3-16a3-4c5e-94f1-07baf827edcb', 'mac_address': 'fa:16:3e:a1:f1:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 00:59:53.129699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4499fdb3-16, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:53.130175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-4499fdb3-16, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:53.130889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-4499fdb3-16, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:53.133133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:53.136253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4499fdb3-16, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:53.157394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:53.174606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dd2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:53.175300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:313 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.058 Oct 16 00:59:53.175835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:59:53.178704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:59:53.182802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:59:53.184349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:59:53.196176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:59:53.282368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c76638-8e92-42fb-ad71-430f2b3e9a8e]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:59:53.283145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:313 - agent port security group processed in 0.166 Oct 16 00:59:53.284009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 4499fdb3-16a3-4c5e-94f1-07baf827edcb to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:53.347944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-94ce912c-ab35-4876-a319-1640e547b6e5 None None] Resource Port d6141001-454c-4247-9f8c-c8bedfbcc602 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=d6141001-454c-4247-9f8c-c8bedfbcc602,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d6141001-454c-4247-9f8c-c8bedfbcc602,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:53.349600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-94ce912c-ab35-4876-a319-1640e547b6e5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6141001-454c-4247-9f8c-c8bedfbcc602), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:53.866039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['4499fdb3-16a3-4c5e-94f1-07baf827edcb'] and devices down [] completed. Oct 16 00:59:53.868245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:313 - ports processed. Elapsed:0.764 Oct 16 00:59:53.868769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.765 Oct 16 00:59:54.137955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-94ce912c-ab35-4876-a319-1640e547b6e5 None None] Resource Port d6141001-454c-4247-9f8c-c8bedfbcc602 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d6141001-454c-4247-9f8c-c8bedfbcc602,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d6141001-454c-4247-9f8c-c8bedfbcc602,segment=NetworkSegment(e85c3ee2-f8b6-42c0-8def-930e36cc19ac),segment_id=e85c3ee2-f8b6-42c0-8def-930e36cc19ac)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d6141001-454c-4247-9f8c-c8bedfbcc602,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:54.139337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-94ce912c-ab35-4876-a319-1640e547b6e5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6141001-454c-4247-9f8c-c8bedfbcc602), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:54.209543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1272aa80-3a6d-4b58-aabb-f0ebc4e8a87a None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:53Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3ddf9fc6-b7ec-4894-844e-44f84b7c3b07',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=58159a88-5783-4e48-abef-6853eb73d938,mac_address=fa:16:3e:41:fc:7d,name='',network_id=3ddf9fc6-b7ec-4894-844e-44f84b7c3b07,numa_affinity_policy=,project_id='403b173e9ff04603b1c33837dcd1ba73',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(58159a88-5783-4e48-abef-6853eb73d938),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:59:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:54.210203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1272aa80-3a6d-4b58-aabb-f0ebc4e8a87a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (58159a88-5783-4e48-abef-6853eb73d938), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:54.309290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["14e2c558-1c55-4d88-a1df-022b3d9d9a0c","insert","qr-d6141001-45",["set",[]],["map",[["attached-mac","fa:16:3e:67:c9:31"],["iface-id","d6141001-454c-4247-9f8c-c8bedfbcc602"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:54.321957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["14e2c558-1c55-4d88-a1df-022b3d9d9a0c","old",null,["set",[]],null],["","new","qr-d6141001-45",20,["map",[["attached-mac","fa:16:3e:67:c9:31"],["iface-id","d6141001-454c-4247-9f8c-c8bedfbcc602"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:54.785348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1272aa80-3a6d-4b58-aabb-f0ebc4e8a87a None None] Resource Port 58159a88-5783-4e48-abef-6853eb73d938 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=58159a88-5783-4e48-abef-6853eb73d938,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=58159a88-5783-4e48-abef-6853eb73d938,segment=NetworkSegment(0942553e-2aee-4b84-ab5c-33fc9ebfbe94),segment_id=0942553e-2aee-4b84-ab5c-33fc9ebfbe94)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=58159a88-5783-4e48-abef-6853eb73d938,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:54.785740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1272aa80-3a6d-4b58-aabb-f0ebc4e8a87a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (58159a88-5783-4e48-abef-6853eb73d938), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:54.957422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cfa81f0a-2611-48cd-8003-1d833cdf6c0f","insert","tap58159a88-57",["set",[]],["map",[["attached-mac","fa:16:3e:41:fc:7d"],["iface-id","58159a88-5783-4e48-abef-6853eb73d938"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:54.978427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cfa81f0a-2611-48cd-8003-1d833cdf6c0f","old",null,["set",[]],null],["","new","tap58159a88-57",21,["map",[["attached-mac","fa:16:3e:41:fc:7d"],["iface-id","58159a88-5783-4e48-abef-6853eb73d938"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 00:59:55.105365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:314 started Oct 16 00:59:55.108813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=751000000,duration_sec=661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:55.109576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:55.110267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:314 - starting polling. Elapsed:0.006 Oct 16 00:59:55.112960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:55.117326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:314 - port information retrieved. Elapsed:0.013 Oct 16 00:59:55.117897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', 'd6141001-454c-4247-9f8c-c8bedfbcc602'}, 'added': {'d6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938'}, 'removed': set(), 'updated': {'d6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:59:55.118852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'mac_address': 'fa:16:3e:67:c9:31', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:55.119516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '58159a88-5783-4e48-abef-6853eb73d938', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '58159a88-5783-4e48-abef-6853eb73d938', 'mac_address': 'fa:16:3e:41:fc:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:55.123009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d6141001-454c-4247-9f8c-c8bedfbcc602 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:55.123550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d6141001-454c-4247-9f8c-c8bedfbcc602 updated. Details: {'device': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'mac_address': 'fa:16:3e:67:c9:31', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 16 00:59:55.125126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6141001-45, col_values=(('tag', 8),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.125894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d6141001-45, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.126470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d6141001-45, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.138773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6141001-45, col_values=(('other_config', {'net_uuid': '67400858-429f-4052-a9a5-3012690406d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '351'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.153588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dd6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:55.154238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 58159a88-5783-4e48-abef-6853eb73d938 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:55.154757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 58159a88-5783-4e48-abef-6853eb73d938 updated. Details: {'device': '58159a88-5783-4e48-abef-6853eb73d938', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '58159a88-5783-4e48-abef-6853eb73d938', 'mac_address': 'fa:16:3e:41:fc:7d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 00:59:55.155286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 9 as local vlan for net-id=3ddf9fc6-b7ec-4894-844e-44f84b7c3b07, seg-id=398 Oct 16 00:59:55.159128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c8f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4494), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:55.162020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416dd8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4494}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:55.163495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58159a88-57, col_values=(('tag', 9),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.164210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap58159a88-57, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.164816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap58159a88-57, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.182354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58159a88-57, col_values=(('other_config', {'net_uuid': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '398'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:55.197969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dda,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:55.198797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:314 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.080 Oct 16 00:59:55.199331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 2 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 00:59:55.200631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'d6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938'} Oct 16 00:59:55.203767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:59:55.204288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:59:55.209524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:59:55.235284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7d6f6aa-18ea-46b4-afe0-fa05edea5331 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:54Z,data_plane_status=None,description='',device_id='ccd44bba-f220-4e23-991f-31f6ef9b3518',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,mac_address=fa:16:3e:64:8c:e7,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(70290c51-f188-4c1e-8e6c-a1cdcf26ed1a),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:59:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:55.235683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7d6f6aa-18ea-46b4-afe0-fa05edea5331 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70290c51-f188-4c1e-8e6c-a1cdcf26ed1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:55.293286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a3a1f-7b51-49ba-9524-ef14a8c78c4b]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:59:55.293922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:314 - agent port security group processed in 0.175 Oct 16 00:59:55.295010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d6141001-454c-4247-9f8c-c8bedfbcc602 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:55.295320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 58159a88-5783-4e48-abef-6853eb73d938 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:55.792210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port d6141001-454c-4247-9f8c-c8bedfbcc602 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:55.793657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d6141001-454c-4247-9f8c-c8bedfbcc602), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:56.229538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['d6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938'] and devices down [] completed. Oct 16 00:59:56.230264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:314 - ports processed. Elapsed:1.125 Oct 16 00:59:56.231000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:1.126 Oct 16 00:59:56.864370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 58159a88-5783-4e48-abef-6853eb73d938 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:56.865426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (58159a88-5783-4e48-abef-6853eb73d938), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:57.106008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:315 started Oct 16 00:59:57.109270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ddc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=752000000,duration_sec=663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:57.111289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:57.111865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:315 - starting polling. Elapsed:0.006 Oct 16 00:59:57.114672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:57.118133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:315 - port information retrieved. Elapsed:0.012 Oct 16 00:59:57.122543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'added': set(), 'removed': set(), 'updated': {'d6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 00:59:57.123725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'mac_address': 'fa:16:3e:67:c9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:57.124424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '58159a88-5783-4e48-abef-6853eb73d938', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '58159a88-5783-4e48-abef-6853eb73d938', 'mac_address': 'fa:16:3e:41:fc:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 00:59:57.135013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d6141001-454c-4247-9f8c-c8bedfbcc602 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:57.135713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d6141001-454c-4247-9f8c-c8bedfbcc602 updated. Details: {'device': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'device_id': 'a3c357fc-2a80-4724-a0d4-f2fc5e3371c9', 'network_id': '67400858-429f-4052-a9a5-3012690406d5', 'port_id': 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'mac_address': 'fa:16:3e:67:c9:31', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 351, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '85abdef7-ce07-4fe0-b80f-da308604c12a', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Oct 16 00:59:57.137090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6141001-45, col_values=(('tag', 8),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.138878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d6141001-45, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.141585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d6141001-45, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.146706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:57.148580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6141001-45, col_values=(('other_config', {'net_uuid': '67400858-429f-4052-a9a5-3012690406d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '351', 'tag': '8'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.153888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:57.166963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dde,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:57.178519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 58159a88-5783-4e48-abef-6853eb73d938 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 00:59:57.179258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 58159a88-5783-4e48-abef-6853eb73d938 updated. Details: {'device': '58159a88-5783-4e48-abef-6853eb73d938', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '58159a88-5783-4e48-abef-6853eb73d938', 'mac_address': 'fa:16:3e:41:fc:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 16 00:59:57.180643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58159a88-57, col_values=(('tag', 9),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.183932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap58159a88-57, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.184655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap58159a88-57, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.185310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:57.189121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap58159a88-57, col_values=(('other_config', {'net_uuid': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '398', 'tag': '9'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 00:59:57.190201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 00:59:57.198360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416de0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:57.201081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:315 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.078 Oct 16 00:59:57.201873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 2 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 00:59:57.202262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 00:59:57.206931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 00:59:57.207374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 00:59:57.220576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 00:59:57.304235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f77ddb-c860-47b0-b060-13e857207a15]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 00:59:57.305079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:315 - agent port security group processed in 0.182 Oct 16 00:59:57.305934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d6141001-454c-4247-9f8c-c8bedfbcc602 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:57.307000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 58159a88-5783-4e48-abef-6853eb73d938 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 00:59:58.031074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79a5a1db-0e09-4966-a30c-ad3538bbec9b tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Resource Port deleted: d54d07bd-690c-4b92-9057-f975e6160581 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 00:59:58.031626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79a5a1db-0e09-4966-a30c-ad3538bbec9b tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (d54d07bd-690c-4b92-9057-f975e6160581), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:58.032046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79a5a1db-0e09-4966-a30c-ad3538bbec9b tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Security group member updated {'fb55519e-722d-49f4-9a24-42b82b48aa56'} Oct 16 00:59:58.809438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['d6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938'] and devices down [] completed. Oct 16 00:59:58.810025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:315 - ports processed. Elapsed:1.704 Oct 16 00:59:58.810025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:1.704 Oct 16 00:59:59.106841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:316 started Oct 16 00:59:59.111354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416de2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=753000000,duration_sec=665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 00:59:59.112285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 00:59:59.112796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:316 - starting polling. Elapsed:0.006 Oct 16 00:59:59.115757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:59.118110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d54d07bd-690c-4b92-9057-f975e6160581 not present in bridge br-int Oct 16 00:59:59.118980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 00:59:59.119545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['d54d07bd-690c-4b92-9057-f975e6160581'] Oct 16 00:59:59.121837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d54d07bd-690c-4b92-9057-f975e6160581 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 00:59:59.132675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:316 - port information retrieved. Elapsed:0.026 Oct 16 00:59:59.135925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.029 Oct 16 00:59:59.222580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-41b895e4-cbe3-4e33-9503-83e9f701722b tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:57Z,data_plane_status=None,description='',device_id='a14ab912-59d2-449f-b756-d19cad8d7b96',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=eacd06b0-a0a4-40d4-b556-dd29e648da3c,mac_address=fa:16:3e:09:83:d6,name='',network_id=f6d9aa56-b330-4b62-a416-c067206c96f0,numa_affinity_policy=,project_id='5462fcbfca114c8885f77f42b479b13d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(eacd06b0-a0a4-40d4-b556-dd29e648da3c),security_group_ids=set([e4a83e87-e8e3-429b-8d31-804d75d095e2]),status='DOWN',updated_at=2022-10-16T00:59:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 00:59:59.223681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-41b895e4-cbe3-4e33-9503-83e9f701722b tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (eacd06b0-a0a4-40d4-b556-dd29e648da3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 00:59:59.224726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-41b895e4-cbe3-4e33-9503-83e9f701722b tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group member updated {'e4a83e87-e8e3-429b-8d31-804d75d095e2'} Oct 16 00:59:59.815417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d2305757-a7bb-47a2-8e86-47497763ed15 None None] Resource Port 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 00:59:59.816837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d2305757-a7bb-47a2-8e86-47497763ed15 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70290c51-f188-4c1e-8e6c-a1cdcf26ed1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:00.265004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d2305757-a7bb-47a2-8e86-47497763ed15 None None] Resource Port 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:00.265400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d2305757-a7bb-47a2-8e86-47497763ed15 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70290c51-f188-4c1e-8e6c-a1cdcf26ed1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:00.303709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6be8ca5-04e1-4cf8-b7a5-a99e1a7539ad admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T00:59:59Z,data_plane_status=None,description='',device_id='ccd44bba-f220-4e23-991f-31f6ef9b3518',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6602cfc3-b450-43d0-b2b3-391416a4e3fb,mac_address=fa:16:3e:30:b1:52,name='',network_id=3ddf9fc6-b7ec-4894-844e-44f84b7c3b07,numa_affinity_policy=,project_id='403b173e9ff04603b1c33837dcd1ba73',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6602cfc3-b450-43d0-b2b3-391416a4e3fb),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T00:59:59Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:00.304110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a6be8ca5-04e1-4cf8-b7a5-a99e1a7539ad admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6602cfc3-b450-43d0-b2b3-391416a4e3fb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:01.012067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9afe30ac-5c4f-451e-bd6e-79c4de3bcb75 service neutron] Resource Port eacd06b0-a0a4-40d4-b556-dd29e648da3c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=eacd06b0-a0a4-40d4-b556-dd29e648da3c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=eacd06b0-a0a4-40d4-b556-dd29e648da3c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:01.012812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9afe30ac-5c4f-451e-bd6e-79c4de3bcb75 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (eacd06b0-a0a4-40d4-b556-dd29e648da3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:01.110407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:317 started Oct 16 01:00:01.114193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416de4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=756000000,duration_sec=667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:01.116261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:01.117092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:317 - starting polling. Elapsed:0.007 Oct 16 01:00:01.121604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:01.129056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:317 - port information retrieved. Elapsed:0.019 Oct 16 01:00:01.129972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 16 01:00:01.482119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ed6142c3-7300-4b39-8784-9c5b1547c2d4","insert","qg-70290c51-f1",["set",[]],["map",[["attached-mac","fa:16:3e:64:8c:e7"],["iface-id","70290c51-f188-4c1e-8e6c-a1cdcf26ed1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:01.498116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ed6142c3-7300-4b39-8784-9c5b1547c2d4","old",null,["set",[]],null],["","new","qg-70290c51-f1",22,["map",[["attached-mac","fa:16:3e:64:8c:e7"],["iface-id","70290c51-f188-4c1e-8e6c-a1cdcf26ed1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:01.768828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9afe30ac-5c4f-451e-bd6e-79c4de3bcb75 service neutron] Resource Port eacd06b0-a0a4-40d4-b556-dd29e648da3c updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=eacd06b0-a0a4-40d4-b556-dd29e648da3c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=eacd06b0-a0a4-40d4-b556-dd29e648da3c,segment=NetworkSegment(6387b2f2-0bee-4573-8938-2efc29213a5f),segment_id=6387b2f2-0bee-4573-8938-2efc29213a5f)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=eacd06b0-a0a4-40d4-b556-dd29e648da3c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:01.769301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9afe30ac-5c4f-451e-bd6e-79c4de3bcb75 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (eacd06b0-a0a4-40d4-b556-dd29e648da3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:02.391472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a6be8ca5-04e1-4cf8-b7a5-a99e1a7539ad admin admin] Received resource Port update without any changes: 6602cfc3-b450-43d0-b2b3-391416a4e3fb {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 01:00:03.112444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:318 started Oct 16 01:00:03.115747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416de6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=758000000,duration_sec=669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:03.116399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:03.116888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:318 - starting polling. Elapsed:0.005 Oct 16 01:00:03.120470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:03.129760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:318 - port information retrieved. Elapsed:0.015 Oct 16 01:00:03.130131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'added': {'70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:03.130750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'mac_address': 'fa:16:3e:64:8c:e7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:03.134205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:03.134404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a updated. Details: {'device': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'mac_address': 'fa:16:3e:64:8c:e7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:00:03.148806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-70290c51-f1, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:03.149488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-70290c51-f1, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:03.150539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-70290c51-f1, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:03.162976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-70290c51-f1, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:03.193529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416de8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:03.200410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:318 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.070 Oct 16 01:00:03.200960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:03.201433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'} Oct 16 01:00:03.203207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:03.203827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:03.208432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:03.347565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2689d56-cb82-4a87-b7e9-8ec9981a9a0b]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:03.348450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:318 - agent port security group processed in 0.218 Oct 16 01:00:03.349395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:03.849254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'] and devices down [] completed. Oct 16 01:00:03.849852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:318 - ports processed. Elapsed:0.737 Oct 16 01:00:03.849947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.738 Oct 16 01:00:03.992357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=70290c51-f188-4c1e-8e6c-a1cdcf26ed1a,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:03.992778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70290c51-f188-4c1e-8e6c-a1cdcf26ed1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:04.622946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:00:04Z,description='tempest-secgroup-smoke-1119436186 description',id=04a6f405-fb32-4245-a68e-14ecec65861c,is_default=False,name='tempest-secgroup-smoke-1119436186',project_id='cb1743385ea14cc39244c83e8fc88e7e',revision_number=1,rules=[SecurityGroupRule(097610ca-40ff-4e1d-84b1-0c6b0e68c83e),SecurityGroupRule(4ca20f0b-9143-4b3f-8784-ef19af3588e8)],shared=False,stateful=True,updated_at=2022-10-16T01:00:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:04.623334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (04a6f405-fb32-4245-a68e-14ecec65861c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:04.624789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:04Z,description=,direction='egress',ethertype='IPv6',id=097610ca-40ff-4e1d-84b1-0c6b0e68c83e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:04.625385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (097610ca-40ff-4e1d-84b1-0c6b0e68c83e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:04.625906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:04.627066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:04Z,description=,direction='egress',ethertype='IPv4',id=4ca20f0b-9143-4b3f-8784-ef19af3588e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:04.627622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4ca20f0b-9143-4b3f-8784-ef19af3588e8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:04.628739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6653d079-a17a-4cb2-82d1-a66b83b8461f tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:04.827281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d225ad0a-5c4b-4a9f-bfa3-70b85dff05f6 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:04Z,description='',direction='ingress',ethertype='IPv4',id=b3dc21cc-c421-4382-a102-8b8b5597fcea,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:04Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:04.827679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d225ad0a-5c4b-4a9f-bfa3-70b85dff05f6 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b3dc21cc-c421-4382-a102-8b8b5597fcea), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:04.828036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d225ad0a-5c4b-4a9f-bfa3-70b85dff05f6 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:05.115189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:319 started Oct 16 01:00:05.121827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=762000000,duration_sec=671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:05.123226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:05.124056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:319 - starting polling. Elapsed:0.009 Oct 16 01:00:05.146798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:05.157186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:319 - port information retrieved. Elapsed:0.042 Oct 16 01:00:05.159007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'added': set(), 'removed': set(), 'updated': {'70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:05.163459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'mac_address': 'fa:16:3e:64:8c:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:05.167193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:05.174076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a updated. Details: {'device': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'mac_address': 'fa:16:3e:64:8c:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:00:05.175551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-70290c51-f1, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:05.176183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-70290c51-f1, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:05.176779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-70290c51-f1, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:05.178683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:05.201991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cb77e9a-370c-456c-9d65-56a615bd78b9 None None] Resource Port 6602cfc3-b450-43d0-b2b3-391416a4e3fb updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=6602cfc3-b450-43d0-b2b3-391416a4e3fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6602cfc3-b450-43d0-b2b3-391416a4e3fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:05.207097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cb77e9a-370c-456c-9d65-56a615bd78b9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6602cfc3-b450-43d0-b2b3-391416a4e3fb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:05.208359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-70290c51-f1, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:05.209677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:05.220988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dec,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:05.224476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:319 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.065 Oct 16 01:00:05.225098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:05.226483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:05.229747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:05.233237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:05.238236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:05.291467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b1ba0607-3195-4978-a54a-ef15d96e2cb8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:05Z,description='',direction='egress',ethertype='IPv4',id=daec3887-43a8-4593-ac89-8d9e89eda5b7,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:05.292286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b1ba0607-3195-4978-a54a-ef15d96e2cb8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (daec3887-43a8-4593-ac89-8d9e89eda5b7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:05.292883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b1ba0607-3195-4978-a54a-ef15d96e2cb8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:05.351252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b828dab-452b-4a40-b290-8161ca3d0ae8]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:05.352238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:319 - agent port security group processed in 0.193 Oct 16 01:00:05.354423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:05.514272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3bb9fbaa-7fb0-4bfa-926e-b3b0d24783bb tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:05Z,description='',direction='ingress',ethertype='IPv4',id=fb39c3de-042c-4f25-ba24-bf43005a63e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:05.514933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3bb9fbaa-7fb0-4bfa-926e-b3b0d24783bb tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fb39c3de-042c-4f25-ba24-bf43005a63e0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:05.515558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3bb9fbaa-7fb0-4bfa-926e-b3b0d24783bb tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:05.656247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6cb77e9a-370c-456c-9d65-56a615bd78b9 None None] Resource Port 6602cfc3-b450-43d0-b2b3-391416a4e3fb updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6602cfc3-b450-43d0-b2b3-391416a4e3fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6602cfc3-b450-43d0-b2b3-391416a4e3fb,segment=NetworkSegment(0942553e-2aee-4b84-ab5c-33fc9ebfbe94),segment_id=0942553e-2aee-4b84-ab5c-33fc9ebfbe94)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6602cfc3-b450-43d0-b2b3-391416a4e3fb,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:05.656844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6cb77e9a-370c-456c-9d65-56a615bd78b9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6602cfc3-b450-43d0-b2b3-391416a4e3fb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:05.813973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-185de76f-e35d-46fd-bb96-bca33ba2cbca tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:05Z,description='',direction='egress',ethertype='IPv4',id=43eb4dbc-c451-46db-913f-9a8edce4ac84,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:05.814735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-185de76f-e35d-46fd-bb96-bca33ba2cbca tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (43eb4dbc-c451-46db-913f-9a8edce4ac84), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:05.815319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-185de76f-e35d-46fd-bb96-bca33ba2cbca tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:05.968529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'] and devices down [] completed. Oct 16 01:00:05.968900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:319 - ports processed. Elapsed:0.854 Oct 16 01:00:05.969322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.855 Oct 16 01:00:06.190945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88debcb6-79f2-4b9e-b289-e87dbd7f5f56 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:06Z,description='',direction='ingress',ethertype='IPv6',id=9f6e1d9d-a90d-4c5d-948d-493d9d4f27f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:06.192302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88debcb6-79f2-4b9e-b289-e87dbd7f5f56 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9f6e1d9d-a90d-4c5d-948d-493d9d4f27f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:06.192995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-88debcb6-79f2-4b9e-b289-e87dbd7f5f56 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:06.579516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["97fc4565-ea40-4134-9c04-3ea92d4896fa","insert","qr-6602cfc3-b4",["set",[]],["map",[["attached-mac","fa:16:3e:30:b1:52"],["iface-id","6602cfc3-b450-43d0-b2b3-391416a4e3fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:06.716648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d2727566-5b4a-4659-944c-31714ba99d98 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:06Z,description='',direction='egress',ethertype='IPv6',id=f4c1e8d2-b78e-4cb5-ac43-38df20648003,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cb1743385ea14cc39244c83e8fc88e7e',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=04a6f405-fb32-4245-a68e-14ecec65861c,updated_at=2022-10-16T01:00:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:06.738543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d2727566-5b4a-4659-944c-31714ba99d98 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f4c1e8d2-b78e-4cb5-ac43-38df20648003), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:06.740623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d2727566-5b4a-4659-944c-31714ba99d98 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:00:06.744466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["97fc4565-ea40-4134-9c04-3ea92d4896fa","old",null,["set",[]],null],["","new","qr-6602cfc3-b4",23,["map",[["attached-mac","fa:16:3e:30:b1:52"],["iface-id","6602cfc3-b450-43d0-b2b3-391416a4e3fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:07.117372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:320 started Oct 16 01:00:07.120805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=764000000,duration_sec=673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:07.121516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:07.122067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:320 - starting polling. Elapsed:0.005 Oct 16 01:00:07.128098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:07.132850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:320 - port information retrieved. Elapsed:0.016 Oct 16 01:00:07.144620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'added': {'6602cfc3-b450-43d0-b2b3-391416a4e3fb'}, 'removed': set(), 'updated': {'6602cfc3-b450-43d0-b2b3-391416a4e3fb'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:07.145709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'mac_address': 'fa:16:3e:30:b1:52', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:07.170002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 6602cfc3-b450-43d0-b2b3-391416a4e3fb {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:07.170368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6602cfc3-b450-43d0-b2b3-391416a4e3fb updated. Details: {'device': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'mac_address': 'fa:16:3e:30:b1:52', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 16 01:00:07.181012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6602cfc3-b4, col_values=(('tag', 9),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:07.185376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6602cfc3-b4, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:07.189325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6602cfc3-b4, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:07.244664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6602cfc3-b4, col_values=(('other_config', {'net_uuid': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '398'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:07.281924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416df0,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:07.284429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:320 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.139 Oct 16 01:00:07.286545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:07.291721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'6602cfc3-b450-43d0-b2b3-391416a4e3fb'} Oct 16 01:00:07.294210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:07.294714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:07.313436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:07.435571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9a4ded-a27f-4802-ab47-36a585402668]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:07.436099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:320 - agent port security group processed in 0.291 Oct 16 01:00:07.437102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 6602cfc3-b450-43d0-b2b3-391416a4e3fb to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:07.654403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port eacd06b0-a0a4-40d4-b556-dd29e648da3c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:07.654808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (eacd06b0-a0a4-40d4-b556-dd29e648da3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:08.310037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['6602cfc3-b450-43d0-b2b3-391416a4e3fb'] and devices down [] completed. Oct 16 01:00:08.311214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:320 - ports processed. Elapsed:1.194 Oct 16 01:00:08.311820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.195 Oct 16 01:00:08.547548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 6602cfc3-b450-43d0-b2b3-391416a4e3fb updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:08.547923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6602cfc3-b450-43d0-b2b3-391416a4e3fb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:09.130310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:321 started Oct 16 01:00:09.133864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416df2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=776000000,duration_sec=675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:09.135386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:09.135957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:321 - starting polling. Elapsed:0.006 Oct 16 01:00:09.139550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:09.143443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:321 - port information retrieved. Elapsed:0.013 Oct 16 01:00:09.144057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'added': set(), 'removed': set(), 'updated': {'6602cfc3-b450-43d0-b2b3-391416a4e3fb'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:09.144945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'mac_address': 'fa:16:3e:30:b1:52', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:09.148573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 6602cfc3-b450-43d0-b2b3-391416a4e3fb {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:09.149742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6602cfc3-b450-43d0-b2b3-391416a4e3fb updated. Details: {'device': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'device_id': 'ccd44bba-f220-4e23-991f-31f6ef9b3518', 'network_id': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'port_id': '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'mac_address': 'fa:16:3e:30:b1:52', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '67eb960f-e877-4e93-8af8-8f120433934d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Oct 16 01:00:09.151390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6602cfc3-b4, col_values=(('tag', 9),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:09.152051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6602cfc3-b4, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:09.153135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6602cfc3-b4, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:09.153876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:09.155014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6602cfc3-b4, col_values=(('other_config', {'net_uuid': '3ddf9fc6-b7ec-4894-844e-44f84b7c3b07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '398', 'tag': '9'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:09.155922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:09.160762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416df4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:09.161482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:321 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.017 Oct 16 01:00:09.162162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:09.162688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:09.164193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:09.164706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:09.169440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:09.257053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9b2b44-50d2-4829-9d6d-7543e0912ad4]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:09.257542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:321 - agent port security group processed in 0.113 Oct 16 01:00:09.258603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 6602cfc3-b450-43d0-b2b3-391416a4e3fb to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:09.674598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2eb6de71-d9b1-46da-b024-5b43a615ea1d tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:09Z,data_plane_status=None,description='',device_id='8dd75b99-5bd7-4f32-9735-aeb21a523563',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=70199f9c-b3b8-489f-9600-44bd5461aa30,mac_address=fa:16:3e:d5:b6:4d,name='',network_id=2990507f-5171-4eb8-ae44-3866cf4c43a9,numa_affinity_policy=,project_id='92116166994646b39ec7a4c23e8cedc4',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(70199f9c-b3b8-489f-9600-44bd5461aa30),security_group_ids=set([fb55519e-722d-49f4-9a24-42b82b48aa56]),status='DOWN',updated_at=2022-10-16T01:00:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:09.675292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2eb6de71-d9b1-46da-b024-5b43a615ea1d tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70199f9c-b3b8-489f-9600-44bd5461aa30), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:09.675763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2eb6de71-d9b1-46da-b024-5b43a615ea1d tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Security group member updated {'fb55519e-722d-49f4-9a24-42b82b48aa56'} Oct 16 01:00:09.678252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['6602cfc3-b450-43d0-b2b3-391416a4e3fb'] and devices down [] completed. Oct 16 01:00:09.678671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:321 - ports processed. Elapsed:0.548 Oct 16 01:00:09.679367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.549 Oct 16 01:00:09.811515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port eacd06b0-a0a4-40d4-b556-dd29e648da3c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:09.811913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (eacd06b0-a0a4-40d4-b556-dd29e648da3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:10.881699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ac142e-30c1-49c4-94f2-2cad22a17169 service neutron] Resource Port 70199f9c-b3b8-489f-9600-44bd5461aa30 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=70199f9c-b3b8-489f-9600-44bd5461aa30,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=70199f9c-b3b8-489f-9600-44bd5461aa30,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:10.882366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ac142e-30c1-49c4-94f2-2cad22a17169 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70199f9c-b3b8-489f-9600-44bd5461aa30), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.131688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:322 started Oct 16 01:00:11.134953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416df6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=777000000,duration_sec=677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:11.135625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:11.135966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:322 - starting polling. Elapsed:0.004 Oct 16 01:00:11.138551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.141953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:322 - port information retrieved. Elapsed:0.010 Oct 16 01:00:11.142269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 01:00:11.230287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ac142e-30c1-49c4-94f2-2cad22a17169 service neutron] Resource Port 70199f9c-b3b8-489f-9600-44bd5461aa30 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=70199f9c-b3b8-489f-9600-44bd5461aa30,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=70199f9c-b3b8-489f-9600-44bd5461aa30,segment=NetworkSegment(4d693cf3-b43f-41e8-8a4a-dae4c48f093a),segment_id=4d693cf3-b43f-41e8-8a4a-dae4c48f093a)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=70199f9c-b3b8-489f-9600-44bd5461aa30,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:11.230769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ac142e-30c1-49c4-94f2-2cad22a17169 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70199f9c-b3b8-489f-9600-44bd5461aa30), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.986064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:00:11Z,description='Default security group',id=6b53043e-4e1c-470b-abed-fab279e56b6c,is_default=True,name='default',project_id='486aaad8b7324b38b38eba267348eed8',revision_number=1,rules=[SecurityGroupRule(0f3f06c1-e4ef-440d-8193-5a10dd568565),SecurityGroupRule(1be08241-457e-40b4-8fef-a049d98eec00),SecurityGroupRule(c3dd261c-dc3e-47ea-9199-8f0244e475e0),SecurityGroupRule(dfc2885c-6e73-41ff-9f29-227a096a91fa)],shared=False,stateful=True,updated_at=2022-10-16T01:00:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:11.987024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (6b53043e-4e1c-470b-abed-fab279e56b6c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.987890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:11Z,description=,direction='egress',ethertype='IPv6',id=0f3f06c1-e4ef-440d-8193-5a10dd568565,normalized_cidr=None,port_range_max=,port_range_min=,project_id='486aaad8b7324b38b38eba267348eed8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6b53043e-4e1c-470b-abed-fab279e56b6c,updated_at=2022-10-16T01:00:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:11.988446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0f3f06c1-e4ef-440d-8193-5a10dd568565), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.988784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:11.989669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:11Z,description=,direction='ingress',ethertype='IPv6',id=1be08241-457e-40b4-8fef-a049d98eec00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='486aaad8b7324b38b38eba267348eed8',protocol=,remote_address_group_id=,remote_group_id=6b53043e-4e1c-470b-abed-fab279e56b6c,remote_ip_prefix=,revision_number=0,security_group_id=6b53043e-4e1c-470b-abed-fab279e56b6c,updated_at=2022-10-16T01:00:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:11.990032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1be08241-457e-40b4-8fef-a049d98eec00), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.990371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:11.991063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:11Z,description=,direction='egress',ethertype='IPv4',id=c3dd261c-dc3e-47ea-9199-8f0244e475e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='486aaad8b7324b38b38eba267348eed8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6b53043e-4e1c-470b-abed-fab279e56b6c,updated_at=2022-10-16T01:00:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:11.991425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c3dd261c-dc3e-47ea-9199-8f0244e475e0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.991882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:11.992548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:11Z,description=,direction='ingress',ethertype='IPv4',id=dfc2885c-6e73-41ff-9f29-227a096a91fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='486aaad8b7324b38b38eba267348eed8',protocol=,remote_address_group_id=,remote_group_id=6b53043e-4e1c-470b-abed-fab279e56b6c,remote_ip_prefix=,revision_number=0,security_group_id=6b53043e-4e1c-470b-abed-fab279e56b6c,updated_at=2022-10-16T01:00:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:11.992903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dfc2885c-6e73-41ff-9f29-227a096a91fa), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:11.993248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-465aec2a-1b50-4d8a-92ae-617656b7b029 admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:12.146539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Resource SecurityGroup deleted: 6b53043e-4e1c-470b-abed-fab279e56b6c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:12.146996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (6b53043e-4e1c-470b-abed-fab279e56b6c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:12.147409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6b53043e-4e1c-470b-abed-fab279e56b6c',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:00:12.169477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6b53043e-4e1c-470b-abed-fab279e56b6c',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:00:12.170096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Resource SecurityGroupRule deleted: 0f3f06c1-e4ef-440d-8193-5a10dd568565 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:12.170584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0f3f06c1-e4ef-440d-8193-5a10dd568565), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:12.170985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:12.171481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Resource SecurityGroupRule deleted: 1be08241-457e-40b4-8fef-a049d98eec00 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:12.171884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1be08241-457e-40b4-8fef-a049d98eec00), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:12.172241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:12.172665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Resource SecurityGroupRule deleted: c3dd261c-dc3e-47ea-9199-8f0244e475e0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:12.173016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c3dd261c-dc3e-47ea-9199-8f0244e475e0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:12.173341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:12.173743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Resource SecurityGroupRule deleted: dfc2885c-6e73-41ff-9f29-227a096a91fa {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:12.174127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dfc2885c-6e73-41ff-9f29-227a096a91fa), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:12.174419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-edf38669-c8c5-4bf9-8126-9c8b6369557a admin admin] Security group rule updated ['6b53043e-4e1c-470b-abed-fab279e56b6c'] Oct 16 01:00:13.133084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:323 started Oct 16 01:00:13.135910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416df8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=779000000,duration_sec=679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:13.136405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:13.136758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:323 - starting polling. Elapsed:0.004 Oct 16 01:00:13.139492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.152816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:323 - port information retrieved. Elapsed:0.020 Oct 16 01:00:13.153167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 16 01:00:13.188284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:00:13Z,description='Default security group',id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,is_default=True,name='default',project_id='ed24cab62e1f4810a10e7ba36fcbeadb',revision_number=1,rules=[SecurityGroupRule(6a04c12a-f753-458c-896e-b7bf0c196494),SecurityGroupRule(850f0e26-b5f2-4486-8992-c68fcbc8abb6),SecurityGroupRule(c6f52174-8c16-40eb-a264-1cb3fe2568c9),SecurityGroupRule(f1c9f430-62d5-4fc3-8a6c-9a3fe3aa7cea)],shared=False,stateful=True,updated_at=2022-10-16T01:00:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.188801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (891f04f3-e71b-49ac-a5a5-21aec2e61c00), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.189846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:13Z,description=,direction='ingress',ethertype='IPv6',id=6a04c12a-f753-458c-896e-b7bf0c196494,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol=,remote_address_group_id=,remote_group_id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,remote_ip_prefix=,revision_number=0,security_group_id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,updated_at=2022-10-16T01:00:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.190481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6a04c12a-f753-458c-896e-b7bf0c196494), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.191125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:00:13.192018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:13Z,description=,direction='egress',ethertype='IPv4',id=850f0e26-b5f2-4486-8992-c68fcbc8abb6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,updated_at=2022-10-16T01:00:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.192567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (850f0e26-b5f2-4486-8992-c68fcbc8abb6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.193299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:00:13.193984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:13Z,description=,direction='ingress',ethertype='IPv4',id=c6f52174-8c16-40eb-a264-1cb3fe2568c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol=,remote_address_group_id=,remote_group_id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,remote_ip_prefix=,revision_number=0,security_group_id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,updated_at=2022-10-16T01:00:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.194344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c6f52174-8c16-40eb-a264-1cb3fe2568c9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.194855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:00:13.195725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:13Z,description=,direction='egress',ethertype='IPv6',id=f1c9f430-62d5-4fc3-8a6c-9a3fe3aa7cea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=891f04f3-e71b-49ac-a5a5-21aec2e61c00,updated_at=2022-10-16T01:00:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.196453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f1c9f430-62d5-4fc3-8a6c-9a3fe3aa7cea), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.196713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:00:13.402982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T01:00:13Z,description='',dns_domain=None,id=aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae,mtu=1500,name='tempest-TestShelveInstance-2015288312-network',project_id='ed24cab62e1f4810a10e7ba36fcbeadb',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae),segments=[NetworkSegment(2d088789-908c-4e34-9f6c-bb4e4f096ea2)],shared=False,status='ACTIVE',updated_at=2022-10-16T01:00:13Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.402982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.563166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:13.563553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-769da83e-d40a-4dc0-938c-13c8d4dd9042 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae with segmentation id not found. Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 01:00:13.566438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 01:00:13.567514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 01:00:13.567514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 01:00:13.567514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 01:00:13.567514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae with segmentation id not found. Oct 16 01:00:13.567514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 01:00:13.684510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7108a5c1-bb38-4c6a-8e50-c7323db55cc3 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(dc66bf04-8e85-45e5-a86f-d79f8ff268b7)],cidr=172.20.0.0/28,created_at=2022-10-16T01:00:13Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=de2290f6-6368-4cf5-9301-7df9595cdb2f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-2015288312-subnet',network_id=aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T01:00:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:13.684802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7108a5c1-bb38-4c6a-8e50-c7323db55cc3 admin admin] Publish callbacks [] for Subnet (de2290f6-6368-4cf5-9301-7df9595cdb2f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:14.337731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2a7473a1-22ae-4b45-85af-c21d66147b8e None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:13Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ae7a598c-abda-4719-a81e-669ce56a67f1,mac_address=fa:16:3e:f0:7d:26,name='',network_id=aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae,numa_affinity_policy=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ae7a598c-abda-4719-a81e-669ce56a67f1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:00:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:14.339247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2a7473a1-22ae-4b45-85af-c21d66147b8e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae7a598c-abda-4719-a81e-669ce56a67f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:14.656255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2a7473a1-22ae-4b45-85af-c21d66147b8e None None] Resource Port ae7a598c-abda-4719-a81e-669ce56a67f1 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ae7a598c-abda-4719-a81e-669ce56a67f1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ae7a598c-abda-4719-a81e-669ce56a67f1,segment=NetworkSegment(2d088789-908c-4e34-9f6c-bb4e4f096ea2),segment_id=2d088789-908c-4e34-9f6c-bb4e4f096ea2)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ae7a598c-abda-4719-a81e-669ce56a67f1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:14.656831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2a7473a1-22ae-4b45-85af-c21d66147b8e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae7a598c-abda-4719-a81e-669ce56a67f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:14.912632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0790d68f-a0cc-4169-801b-6920aa1e4969","insert","tapae7a598c-ab",["set",[]],["map",[["attached-mac","fa:16:3e:f0:7d:26"],["iface-id","ae7a598c-abda-4719-a81e-669ce56a67f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:14.913318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0790d68f-a0cc-4169-801b-6920aa1e4969","old",null,["set",[]],null],["","new","tapae7a598c-ab",24,["map",[["attached-mac","fa:16:3e:f0:7d:26"],["iface-id","ae7a598c-abda-4719-a81e-669ce56a67f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:15.133807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:324 started Oct 16 01:00:15.136302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416dfa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=779000000,duration_sec=681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:15.138663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:15.139181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:324 - starting polling. Elapsed:0.006 Oct 16 01:00:15.144894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:15.156379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:324 - port information retrieved. Elapsed:0.017 Oct 16 01:00:15.156379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'added': {'ae7a598c-abda-4719-a81e-669ce56a67f1'}, 'removed': set(), 'updated': {'ae7a598c-abda-4719-a81e-669ce56a67f1'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:15.161617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'mac_address': 'fa:16:3e:f0:7d:26', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:15.161617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ae7a598c-abda-4719-a81e-669ce56a67f1 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:15.161820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ae7a598c-abda-4719-a81e-669ce56a67f1 updated. Details: {'device': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'mac_address': 'fa:16:3e:f0:7d:26', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 01:00:15.161820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 10 as local vlan for net-id=aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae, seg-id=350 Oct 16 01:00:15.162267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c91,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4446), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:15.166803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416dfc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4446}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:15.175069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae7a598c-ab, col_values=(('tag', 10),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:15.179900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapae7a598c-ab, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:15.181004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapae7a598c-ab, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:15.187567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae7a598c-ab, col_values=(('other_config', {'net_uuid': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '350'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:15.214296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416dfe,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:15.215289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:324 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.063 Oct 16 01:00:15.215720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:15.216091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'ae7a598c-abda-4719-a81e-669ce56a67f1'} Oct 16 01:00:15.217514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:15.217804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:15.226774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:15.286227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b8d0c-ba09-4227-88c7-4f1157faffd2]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:15.287369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:324 - agent port security group processed in 0.135 Oct 16 01:00:15.288413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ae7a598c-abda-4719-a81e-669ce56a67f1 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:15.759080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-675b0e37-245d-4e76-bb87-a2b2b4a21259 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:14Z,data_plane_status=None,description='',device_id='0b991702-89ac-40f9-943f-5178995320ba',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ad486221-b874-47bb-a0e9-8f586fd9fc56,mac_address=fa:16:3e:e7:0d:04,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ad486221-b874-47bb-a0e9-8f586fd9fc56),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:00:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:15.760546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-675b0e37-245d-4e76-bb87-a2b2b4a21259 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ad486221-b874-47bb-a0e9-8f586fd9fc56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:15.772101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ae7a598c-abda-4719-a81e-669ce56a67f1'] and devices down [] completed. Oct 16 01:00:15.772645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:324 - ports processed. Elapsed:0.639 Oct 16 01:00:15.773440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.640 Oct 16 01:00:15.940077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port ae7a598c-abda-4719-a81e-669ce56a67f1 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:15.940817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ae7a598c-abda-4719-a81e-669ce56a67f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:17.135655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:325 started Oct 16 01:00:17.139266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=782000000,duration_sec=683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:17.140073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:17.140614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:325 - starting polling. Elapsed:0.005 Oct 16 01:00:17.143426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:17.152733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:325 - port information retrieved. Elapsed:0.017 Oct 16 01:00:17.155122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'added': set(), 'removed': set(), 'updated': {'ae7a598c-abda-4719-a81e-669ce56a67f1'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:17.155953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'mac_address': 'fa:16:3e:f0:7d:26', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:17.162330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ae7a598c-abda-4719-a81e-669ce56a67f1 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:17.163218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ae7a598c-abda-4719-a81e-669ce56a67f1 updated. Details: {'device': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': 'ae7a598c-abda-4719-a81e-669ce56a67f1', 'mac_address': 'fa:16:3e:f0:7d:26', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 16 01:00:17.170477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae7a598c-ab, col_values=(('tag', 10),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:17.170945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapae7a598c-ab, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:17.174631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapae7a598c-ab, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:17.175703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:17.182662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapae7a598c-ab, col_values=(('other_config', {'net_uuid': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '350', 'tag': '10'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:17.184201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:17.188986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e02,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:17.189610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:325 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.034 Oct 16 01:00:17.190513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:17.191069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:17.193648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:17.194940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:17.204043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:17.258412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0236fa7-c6e2-47cb-aaaf-8b42c078b24f]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:17.261965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:325 - agent port security group processed in 0.106 Oct 16 01:00:17.263919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ae7a598c-abda-4719-a81e-669ce56a67f1 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:17.592137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ae7a598c-abda-4719-a81e-669ce56a67f1'] and devices down [] completed. Oct 16 01:00:17.592538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:325 - ports processed. Elapsed:0.457 Oct 16 01:00:17.592979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.457 Oct 16 01:00:18.219508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c0f998a-8233-4c19-8d70-3f2088394086 None None] Resource Port ad486221-b874-47bb-a0e9-8f586fd9fc56 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:18.220217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c0f998a-8233-4c19-8d70-3f2088394086 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ad486221-b874-47bb-a0e9-8f586fd9fc56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:18.459461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c0f998a-8233-4c19-8d70-3f2088394086 None None] Resource Port ad486221-b874-47bb-a0e9-8f586fd9fc56 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:18.460068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c0f998a-8233-4c19-8d70-3f2088394086 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ad486221-b874-47bb-a0e9-8f586fd9fc56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:18.515274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a0bd4dc9-fac1-4f70-93cd-a6d27d6730ec admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:17Z,data_plane_status=None,description='',device_id='0b991702-89ac-40f9-943f-5178995320ba',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=48424f32-bbb0-49e2-95a3-c10004ab3ea6,mac_address=fa:16:3e:b9:96:fa,name='',network_id=aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae,numa_affinity_policy=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(48424f32-bbb0-49e2-95a3-c10004ab3ea6),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:00:18Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:18.515794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a0bd4dc9-fac1-4f70-93cd-a6d27d6730ec admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (48424f32-bbb0-49e2-95a3-c10004ab3ea6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:19.095137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a0bd4dc9-fac1-4f70-93cd-a6d27d6730ec admin admin] Received resource Port update without any changes: 48424f32-bbb0-49e2-95a3-c10004ab3ea6 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 01:00:19.137595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:326 started Oct 16 01:00:19.141102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=784000000,duration_sec=685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:19.143404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:19.144232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:326 - starting polling. Elapsed:0.007 Oct 16 01:00:19.147372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:19.156111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:326 - port information retrieved. Elapsed:0.019 Oct 16 01:00:19.158220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Oct 16 01:00:19.163639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a756e804-ce3f-4ba3-b604-495add8660be","insert","qg-ad486221-b8",["set",[]],["map",[["attached-mac","fa:16:3e:e7:0d:04"],["iface-id","ad486221-b874-47bb-a0e9-8f586fd9fc56"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:19.194679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a756e804-ce3f-4ba3-b604-495add8660be","old",null,["set",[]],null],["","new","qg-ad486221-b8",25,["map",[["attached-mac","fa:16:3e:e7:0d:04"],["iface-id","ad486221-b874-47bb-a0e9-8f586fd9fc56"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:19.828812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 70199f9c-b3b8-489f-9600-44bd5461aa30 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:19.829637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70199f9c-b3b8-489f-9600-44bd5461aa30), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.562809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:00:20Z,description='Default security group',id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,is_default=True,name='default',project_id='ef2df25edb2b4bee9f71c94e2249e1f7',revision_number=1,rules=[SecurityGroupRule(1cfe6a7f-835b-42c9-9a99-46c1162dde5e),SecurityGroupRule(444cc49b-b24d-4ea7-9d26-08244d389e95),SecurityGroupRule(59aec7e5-7c78-4ca0-aa7f-a77ddb30cef6),SecurityGroupRule(de9d0398-5bd9-4c93-990b-2826da45d017)],shared=False,stateful=True,updated_at=2022-10-16T01:00:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:20.563773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (2430aff5-6ca2-4d6a-8b4c-7570f30f43a1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.564629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:20Z,description=,direction='ingress',ethertype='IPv4',id=1cfe6a7f-835b-42c9-9a99-46c1162dde5e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',protocol=,remote_address_group_id=,remote_group_id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,remote_ip_prefix=,revision_number=0,security_group_id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,updated_at=2022-10-16T01:00:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:20.565215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1cfe6a7f-835b-42c9-9a99-46c1162dde5e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.565770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:00:20.566702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:20Z,description=,direction='egress',ethertype='IPv6',id=444cc49b-b24d-4ea7-9d26-08244d389e95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,updated_at=2022-10-16T01:00:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:20.567323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (444cc49b-b24d-4ea7-9d26-08244d389e95), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.567975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:00:20.568962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:20Z,description=,direction='egress',ethertype='IPv4',id=59aec7e5-7c78-4ca0-aa7f-a77ddb30cef6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,updated_at=2022-10-16T01:00:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:20.569551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (59aec7e5-7c78-4ca0-aa7f-a77ddb30cef6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.570095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:00:20.571044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:20Z,description=,direction='ingress',ethertype='IPv6',id=de9d0398-5bd9-4c93-990b-2826da45d017,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',protocol=,remote_address_group_id=,remote_group_id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,remote_ip_prefix=,revision_number=0,security_group_id=2430aff5-6ca2-4d6a-8b4c-7570f30f43a1,updated_at=2022-10-16T01:00:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:20.571645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (de9d0398-5bd9-4c93-990b-2826da45d017), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.572220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:00:20.801117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T01:00:20Z,description='',dns_domain=None,id=b461444f-0415-4655-b84a-88bf01b40b1a,mtu=1500,name='tempest-TestShelveInstance-665180371-network',project_id='ef2df25edb2b4bee9f71c94e2249e1f7',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(b461444f-0415-4655-b84a-88bf01b40b1a),segments=[NetworkSegment(eed8e0e7-4394-47d2-b07b-185558efbf1c)],shared=False,status='ACTIVE',updated_at=2022-10-16T01:00:20Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:20.801500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (b461444f-0415-4655-b84a-88bf01b40b1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-1dedb4b2-ab73-4d7c-9091-5baef6598129 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b461444f-0415-4655-b84a-88bf01b40b1a with segmentation id not found. Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 01:00:20.902029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 01:00:20.903813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 01:00:20.903813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 01:00:20.903813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 01:00:20.903813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b461444f-0415-4655-b84a-88bf01b40b1a with segmentation id not found. Oct 16 01:00:20.903813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 01:00:21.145269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:327 started Oct 16 01:00:21.151646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=794000000,duration_sec=687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:21.154099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:21.155408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:327 - starting polling. Elapsed:0.010 Oct 16 01:00:21.159793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:21.164030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:327 - port information retrieved. Elapsed:0.019 Oct 16 01:00:21.165000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:21.165873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'mac_address': 'fa:16:3e:e7:0d:04', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.220'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:21.182248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ad486221-b874-47bb-a0e9-8f586fd9fc56 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:21.194326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ad486221-b874-47bb-a0e9-8f586fd9fc56 updated. Details: {'device': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'mac_address': 'fa:16:3e:e7:0d:04', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.220'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:00:21.203304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4334f2d9-857e-4d45-9fe2-f53c64e54ca5 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(42503f26-76d4-41fd-a5bc-1c3b3b0c7a60)],cidr=172.20.0.0/28,created_at=2022-10-16T01:00:20Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=de7a33c4-ae37-49e1-aede-5b4993e82cff,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-665180371-subnet',network_id=b461444f-0415-4655-b84a-88bf01b40b1a,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T01:00:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:21.205204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4334f2d9-857e-4d45-9fe2-f53c64e54ca5 admin admin] Publish callbacks [] for Subnet (de7a33c4-ae37-49e1-aede-5b4993e82cff), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:21.208595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ad486221-b8, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:21.210081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ad486221-b8, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:21.211271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ad486221-b8, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:21.226202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ad486221-b8, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:21.237704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e08,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:21.238557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:327 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.073 Oct 16 01:00:21.239134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:21.239624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'ad486221-b874-47bb-a0e9-8f586fd9fc56'} Oct 16 01:00:21.241152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:21.241678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:21.249836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:21.306988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0a92f5-277d-43ae-9133-2cbd32b629b1]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:21.307629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:327 - agent port security group processed in 0.142 Oct 16 01:00:21.308569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ad486221-b874-47bb-a0e9-8f586fd9fc56 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:21.687415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd5a51e0-2146-4957-a077-a789678cc160 None None] Resource Port 48424f32-bbb0-49e2-95a3-c10004ab3ea6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=48424f32-bbb0-49e2-95a3-c10004ab3ea6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=48424f32-bbb0-49e2-95a3-c10004ab3ea6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:21.687952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd5a51e0-2146-4957-a077-a789678cc160 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (48424f32-bbb0-49e2-95a3-c10004ab3ea6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:22.086053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['ad486221-b874-47bb-a0e9-8f586fd9fc56'] and devices down [] completed. Oct 16 01:00:22.088032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:327 - ports processed. Elapsed:0.943 Oct 16 01:00:22.088680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.943 Oct 16 01:00:22.240064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd5a51e0-2146-4957-a077-a789678cc160 None None] Resource Port 48424f32-bbb0-49e2-95a3-c10004ab3ea6 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=48424f32-bbb0-49e2-95a3-c10004ab3ea6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=48424f32-bbb0-49e2-95a3-c10004ab3ea6,segment=NetworkSegment(2d088789-908c-4e34-9f6c-bb4e4f096ea2),segment_id=2d088789-908c-4e34-9f6c-bb4e4f096ea2)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=48424f32-bbb0-49e2-95a3-c10004ab3ea6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:22.240708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd5a51e0-2146-4957-a077-a789678cc160 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (48424f32-bbb0-49e2-95a3-c10004ab3ea6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:22.258155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port ad486221-b874-47bb-a0e9-8f586fd9fc56 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ad486221-b874-47bb-a0e9-8f586fd9fc56,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:22.258692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ad486221-b874-47bb-a0e9-8f586fd9fc56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:22.345428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 70199f9c-b3b8-489f-9600-44bd5461aa30 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:22.346327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (70199f9c-b3b8-489f-9600-44bd5461aa30), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:22.476886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ceca871-4836-45f8-a13f-bd7b6c0782b3 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:21Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b461444f-0415-4655-b84a-88bf01b40b1a',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c9bf46df-7ac4-440c-8c35-1671b8a9814d,mac_address=fa:16:3e:db:40:ee,name='',network_id=b461444f-0415-4655-b84a-88bf01b40b1a,numa_affinity_policy=,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c9bf46df-7ac4-440c-8c35-1671b8a9814d),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:00:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:22.478908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ceca871-4836-45f8-a13f-bd7b6c0782b3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c9bf46df-7ac4-440c-8c35-1671b8a9814d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:22.702796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["02f7c04c-bb64-42d6-9495-558c4ff7acf6","insert","qr-48424f32-bb",["set",[]],["map",[["attached-mac","fa:16:3e:b9:96:fa"],["iface-id","48424f32-bbb0-49e2-95a3-c10004ab3ea6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:22.717815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["02f7c04c-bb64-42d6-9495-558c4ff7acf6","old",null,["set",[]],null],["","new","qr-48424f32-bb",26,["map",[["attached-mac","fa:16:3e:b9:96:fa"],["iface-id","48424f32-bbb0-49e2-95a3-c10004ab3ea6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:22.757728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4ceca871-4836-45f8-a13f-bd7b6c0782b3 None None] Resource Port c9bf46df-7ac4-440c-8c35-1671b8a9814d updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c9bf46df-7ac4-440c-8c35-1671b8a9814d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c9bf46df-7ac4-440c-8c35-1671b8a9814d,segment=NetworkSegment(eed8e0e7-4394-47d2-b07b-185558efbf1c),segment_id=eed8e0e7-4394-47d2-b07b-185558efbf1c)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c9bf46df-7ac4-440c-8c35-1671b8a9814d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:22.758663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4ceca871-4836-45f8-a13f-bd7b6c0782b3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c9bf46df-7ac4-440c-8c35-1671b8a9814d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:22.878443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5914fe85-8f90-45af-a09b-af9e152ae5fb","insert","tapc9bf46df-7a",["set",[]],["map",[["attached-mac","fa:16:3e:db:40:ee"],["iface-id","c9bf46df-7ac4-440c-8c35-1671b8a9814d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:22.904394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5914fe85-8f90-45af-a09b-af9e152ae5fb","old",null,["set",[]],null],["","new","tapc9bf46df-7a",27,["map",[["attached-mac","fa:16:3e:db:40:ee"],["iface-id","c9bf46df-7ac4-440c-8c35-1671b8a9814d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:23.141790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bc382129-add9-4392-92a4-cd11537693f8 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:22Z,data_plane_status=None,description='',device_id='87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=199a6a07-ef81-454a-9a90-e16388fd8068,mac_address=fa:16:3e:86:96:7b,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(199a6a07-ef81-454a-9a90-e16388fd8068),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:00:22Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:23.143441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bc382129-add9-4392-92a4-cd11537693f8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (199a6a07-ef81-454a-9a90-e16388fd8068), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:23.146892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:328 started Oct 16 01:00:23.151056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=794000000,duration_sec=689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:23.153283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:23.154979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:328 - starting polling. Elapsed:0.007 Oct 16 01:00:23.158928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:23.164616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:328 - port information retrieved. Elapsed:0.018 Oct 16 01:00:23.165182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '48424f32-bbb0-49e2-95a3-c10004ab3ea6'}, 'removed': set(), 'updated': {'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '48424f32-bbb0-49e2-95a3-c10004ab3ea6'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:23.166154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b461444f-0415-4655-b84a-88bf01b40b1a', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'mac_address': 'fa:16:3e:db:40:ee', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:23.166964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'mac_address': 'fa:16:3e:b9:96:fa', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:23.167654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'mac_address': 'fa:16:3e:e7:0d:04', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.220'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:23.172057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: c9bf46df-7ac4-440c-8c35-1671b8a9814d {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:23.172756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port c9bf46df-7ac4-440c-8c35-1671b8a9814d updated. Details: {'device': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b461444f-0415-4655-b84a-88bf01b40b1a', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'mac_address': 'fa:16:3e:db:40:ee', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 01:00:23.174306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 11 as local vlan for net-id=b461444f-0415-4655-b84a-88bf01b40b1a, seg-id=374 Oct 16 01:00:23.185512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c93,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4470), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:23.188929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416e0c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4470}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:23.190452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc9bf46df-7a, col_values=(('tag', 11),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.191090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc9bf46df-7a, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.191682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc9bf46df-7a, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.202494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc9bf46df-7a, col_values=(('other_config', {'net_uuid': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '374'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.220330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e0e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:23.220942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 48424f32-bbb0-49e2-95a3-c10004ab3ea6 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:23.221434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 48424f32-bbb0-49e2-95a3-c10004ab3ea6 updated. Details: {'device': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'mac_address': 'fa:16:3e:b9:96:fa', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 16 01:00:23.222653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-48424f32-bb, col_values=(('tag', 10),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.223137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-48424f32-bb, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.223754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-48424f32-bb, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.235494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-48424f32-bb, col_values=(('other_config', {'net_uuid': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '350'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.247453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e10,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:23.248007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: ad486221-b874-47bb-a0e9-8f586fd9fc56 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:23.248522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ad486221-b874-47bb-a0e9-8f586fd9fc56 updated. Details: {'device': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'mac_address': 'fa:16:3e:e7:0d:04', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.220'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:00:23.250630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ad486221-b8, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.251299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-ad486221-b8, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.251866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-ad486221-b8, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.252465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:23.253954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ad486221-b8, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:23.255302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:23.263921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e12,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:23.264868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:328 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.099 Oct 16 01:00:23.265405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 2 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:23.265886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '48424f32-bbb0-49e2-95a3-c10004ab3ea6'} Oct 16 01:00:23.268913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:23.269420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:23.283309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:23.359417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f6de1c-ed3a-4cdc-b211-27be325d9cd8]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:23.360055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:23.360368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:23.361514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:23.361807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:23.367261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:23.412136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[828bfe56-043e-4a05-a1f6-6b8c9a24716b]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:23.412798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:328 - agent port security group processed in 0.247 Oct 16 01:00:23.413734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for c9bf46df-7ac4-440c-8c35-1671b8a9814d to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:23.414039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 48424f32-bbb0-49e2-95a3-c10004ab3ea6 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:23.415090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for ad486221-b874-47bb-a0e9-8f586fd9fc56 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:23.763608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port c9bf46df-7ac4-440c-8c35-1671b8a9814d updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:23.764166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c9bf46df-7ac4-440c-8c35-1671b8a9814d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:24.201502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 48424f32-bbb0-49e2-95a3-c10004ab3ea6 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:24.202104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (48424f32-bbb0-49e2-95a3-c10004ab3ea6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:24.952038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['c9bf46df-7ac4-440c-8c35-1671b8a9814d', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'] and devices down [] completed. Oct 16 01:00:24.952676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:328 - ports processed. Elapsed:1.806 Oct 16 01:00:24.953371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 3, 'removed': 0}}. Elapsed:1.807 Oct 16 01:00:25.148302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:329 started Oct 16 01:00:25.152734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=794000000,duration_sec=691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:25.153570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:25.153923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:329 - starting polling. Elapsed:0.006 Oct 16 01:00:25.157118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:25.171163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:329 - port information retrieved. Elapsed:0.014 Oct 16 01:00:25.171639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '48424f32-bbb0-49e2-95a3-c10004ab3ea6'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:25.172257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b461444f-0415-4655-b84a-88bf01b40b1a', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'mac_address': 'fa:16:3e:db:40:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:25.172807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'mac_address': 'fa:16:3e:b9:96:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:25.181674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: c9bf46df-7ac4-440c-8c35-1671b8a9814d {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:25.181936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port c9bf46df-7ac4-440c-8c35-1671b8a9814d updated. Details: {'device': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b461444f-0415-4655-b84a-88bf01b40b1a', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', 'mac_address': 'fa:16:3e:db:40:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 16 01:00:25.183105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc9bf46df-7a, col_values=(('tag', 11),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.189163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc9bf46df-7a, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.189780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc9bf46df-7a, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.197243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:25.198259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc9bf46df-7a, col_values=(('other_config', {'net_uuid': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '374', 'tag': '11'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.199252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:25.203181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e16,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:25.203869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 48424f32-bbb0-49e2-95a3-c10004ab3ea6 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:25.203869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 48424f32-bbb0-49e2-95a3-c10004ab3ea6 updated. Details: {'device': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'device_id': '0b991702-89ac-40f9-943f-5178995320ba', 'network_id': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'port_id': '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'mac_address': 'fa:16:3e:b9:96:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de2290f6-6368-4cf5-9301-7df9595cdb2f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Oct 16 01:00:25.204892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-48424f32-bb, col_values=(('tag', 10),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.207157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-48424f32-bb, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.207683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-48424f32-bb, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.208413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:25.210557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-48424f32-bb, col_values=(('other_config', {'net_uuid': 'aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '350', 'tag': '10'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:25.215035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:25.218588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e18,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:25.231426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:329 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.059 Oct 16 01:00:25.235372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 2 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:25.237491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:25.247984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:25.248627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:25.268517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:25.363914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[571c9196-873c-4a6c-b87f-dce70040075c]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:25.365489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:329 - agent port security group processed in 0.193 Oct 16 01:00:25.366618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for c9bf46df-7ac4-440c-8c35-1671b8a9814d to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:25.367981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 48424f32-bbb0-49e2-95a3-c10004ab3ea6 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:26.555623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['c9bf46df-7ac4-440c-8c35-1671b8a9814d', '48424f32-bbb0-49e2-95a3-c10004ab3ea6'] and devices down [] completed. Oct 16 01:00:26.556560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:329 - ports processed. Elapsed:1.408 Oct 16 01:00:26.556560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:1.408 Oct 16 01:00:26.597358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-04e5fb8f-e2a0-4e1f-95dc-ae0a1a4364bb None None] Resource Port 199a6a07-ef81-454a-9a90-e16388fd8068 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=199a6a07-ef81-454a-9a90-e16388fd8068,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=199a6a07-ef81-454a-9a90-e16388fd8068,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:26.598749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-04e5fb8f-e2a0-4e1f-95dc-ae0a1a4364bb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (199a6a07-ef81-454a-9a90-e16388fd8068), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:26.817437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-04e5fb8f-e2a0-4e1f-95dc-ae0a1a4364bb None None] Resource Port 199a6a07-ef81-454a-9a90-e16388fd8068 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=199a6a07-ef81-454a-9a90-e16388fd8068,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=199a6a07-ef81-454a-9a90-e16388fd8068,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=199a6a07-ef81-454a-9a90-e16388fd8068,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:26.817833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-04e5fb8f-e2a0-4e1f-95dc-ae0a1a4364bb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (199a6a07-ef81-454a-9a90-e16388fd8068), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:26.905206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-416ee594-42d6-4962-a5b9-e3e93791aa11 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:26Z,data_plane_status=None,description='',device_id='87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=02def970-29eb-4148-a20d-445ed75d4fe8,mac_address=fa:16:3e:c3:6f:49,name='',network_id=b461444f-0415-4655-b84a-88bf01b40b1a,numa_affinity_policy=,project_id='ef2df25edb2b4bee9f71c94e2249e1f7',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(02def970-29eb-4148-a20d-445ed75d4fe8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:00:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:26.906019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-416ee594-42d6-4962-a5b9-e3e93791aa11 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (02def970-29eb-4148-a20d-445ed75d4fe8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:27.154367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:330 started Oct 16 01:00:27.154367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=797000000,duration_sec=693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:27.155307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:27.155714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:330 - starting polling. Elapsed:0.007 Oct 16 01:00:27.159717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:27.164793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:330 - port information retrieved. Elapsed:0.016 Oct 16 01:00:27.165529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 16 01:00:27.421932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7b00fca6-df18-439d-9ce8-6b81fa6135b3","insert","qg-199a6a07-ef",["set",[]],["map",[["attached-mac","fa:16:3e:86:96:7b"],["iface-id","199a6a07-ef81-454a-9a90-e16388fd8068"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:27.450469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7b00fca6-df18-439d-9ce8-6b81fa6135b3","old",null,["set",[]],null],["","new","qg-199a6a07-ef",28,["map",[["attached-mac","fa:16:3e:86:96:7b"],["iface-id","199a6a07-ef81-454a-9a90-e16388fd8068"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:27.461696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-416ee594-42d6-4962-a5b9-e3e93791aa11 admin admin] Received resource Port update without any changes: 02def970-29eb-4148-a20d-445ed75d4fe8 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 01:00:29.089660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:00:28Z,description='tempest-secgroup-smoke-65457001 description',id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,is_default=False,name='tempest-secgroup-smoke-65457001',project_id='ed24cab62e1f4810a10e7ba36fcbeadb',revision_number=1,rules=[SecurityGroupRule(122170a8-01fe-4f53-abad-fd1d0871e67b),SecurityGroupRule(d7e770de-4791-4d72-8f2f-7653192154b5)],shared=False,stateful=True,updated_at=2022-10-16T01:00:28Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.090387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.090878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:28Z,description=,direction='egress',ethertype='IPv4',id=122170a8-01fe-4f53-abad-fd1d0871e67b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:28Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.091281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (122170a8-01fe-4f53-abad-fd1d0871e67b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.091767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:29.092453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:28Z,description=,direction='egress',ethertype='IPv6',id=d7e770de-4791-4d72-8f2f-7653192154b5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:28Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.093031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d7e770de-4791-4d72-8f2f-7653192154b5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.093136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-23e8bfe5-0c49-4e31-b00b-dd9313cd89aa tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:29.150500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:331 started Oct 16 01:00:29.153016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=796000000,duration_sec=695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:29.153620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:29.154091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:331 - starting polling. Elapsed:0.004 Oct 16 01:00:29.157255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.163085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:331 - port information retrieved. Elapsed:0.013 Oct 16 01:00:29.163836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'199a6a07-ef81-454a-9a90-e16388fd8068'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:29.164795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '199a6a07-ef81-454a-9a90-e16388fd8068', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '199a6a07-ef81-454a-9a90-e16388fd8068', 'mac_address': 'fa:16:3e:86:96:7b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.169'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:29.170085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 199a6a07-ef81-454a-9a90-e16388fd8068 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:29.171026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 199a6a07-ef81-454a-9a90-e16388fd8068 updated. Details: {'device': '199a6a07-ef81-454a-9a90-e16388fd8068', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '199a6a07-ef81-454a-9a90-e16388fd8068', 'mac_address': 'fa:16:3e:86:96:7b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.169'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:00:29.172375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-199a6a07-ef, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:29.176448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-199a6a07-ef, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:29.177222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-199a6a07-ef, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:29.186728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-199a6a07-ef, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:29.194790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e1e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:29.195230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:331 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 24 devices currently available. Time elapsed: 0.031 Oct 16 01:00:29.196098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:29.196408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'199a6a07-ef81-454a-9a90-e16388fd8068'} Oct 16 01:00:29.197574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:29.198239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:29.203865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:29.255973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469ce4b-7c2b-4ea4-a05c-54fc68b8d46e]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:29.261024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:331 - agent port security group processed in 0.096 Oct 16 01:00:29.262320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 199a6a07-ef81-454a-9a90-e16388fd8068 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:29.283833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5dd96325-0593-4c84-85b2-ea16e5531824 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:29Z,description='',direction='ingress',ethertype='IPv4',id=e5be585f-9b97-4c38-ad6e-5ddf224e1215,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.283833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5dd96325-0593-4c84-85b2-ea16e5531824 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e5be585f-9b97-4c38-ad6e-5ddf224e1215), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.283833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5dd96325-0593-4c84-85b2-ea16e5531824 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:29.473541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-eb3c0f30-6c74-4abb-9aac-66e37c951010 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:29Z,description='',direction='egress',ethertype='IPv4',id=e60bc609-7163-4b8d-88f8-a9ea1294e0ce,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.473541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-eb3c0f30-6c74-4abb-9aac-66e37c951010 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e60bc609-7163-4b8d-88f8-a9ea1294e0ce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.473980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-eb3c0f30-6c74-4abb-9aac-66e37c951010 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:29.519674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['199a6a07-ef81-454a-9a90-e16388fd8068'] and devices down [] completed. Oct 16 01:00:29.520003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:331 - ports processed. Elapsed:0.370 Oct 16 01:00:29.520354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.371 Oct 16 01:00:29.710262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 199a6a07-ef81-454a-9a90-e16388fd8068 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=199a6a07-ef81-454a-9a90-e16388fd8068,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=199a6a07-ef81-454a-9a90-e16388fd8068,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:29.711601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (199a6a07-ef81-454a-9a90-e16388fd8068), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.757936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5c2e60d3-116d-475f-8ad8-6228aad15a32 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:29Z,description='',direction='ingress',ethertype='IPv4',id=5189b162-4a82-4891-87a7-b35068dbec39,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.758980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5c2e60d3-116d-475f-8ad8-6228aad15a32 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5189b162-4a82-4891-87a7-b35068dbec39), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.759339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5c2e60d3-116d-475f-8ad8-6228aad15a32 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:29.939237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0a709b2c-faba-4848-aedf-4653b3945372 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:29Z,description='',direction='egress',ethertype='IPv4',id=ed1924ea-fae9-4dbe-bafa-55edb14c619b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:29.940008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0a709b2c-faba-4848-aedf-4653b3945372 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ed1924ea-fae9-4dbe-bafa-55edb14c619b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:29.940550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0a709b2c-faba-4848-aedf-4653b3945372 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:30.206192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7209518-cdab-4132-88d0-b87272a7f41b tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:30Z,description='',direction='ingress',ethertype='IPv6',id=a2847e34-a9d7-4715-80b2-87efcd94e5b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:30.207585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7209518-cdab-4132-88d0-b87272a7f41b tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a2847e34-a9d7-4715-80b2-87efcd94e5b1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:30.207585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e7209518-cdab-4132-88d0-b87272a7f41b tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:30.497169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-729769e8-a822-4ff8-bceb-3934ff011752 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:00:30Z,description='',direction='egress',ethertype='IPv6',id=31185fc2-c566-4621-ad7c-4714b1692950,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9,updated_at=2022-10-16T01:00:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:30.497559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-729769e8-a822-4ff8-bceb-3934ff011752 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (31185fc2-c566-4621-ad7c-4714b1692950), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:30.497909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-729769e8-a822-4ff8-bceb-3934ff011752 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:00:31.151453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:332 started Oct 16 01:00:31.156494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=798000000,duration_sec=697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:31.159843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:31.161139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:332 - starting polling. Elapsed:0.010 Oct 16 01:00:31.174554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:31.196699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:332 - port information retrieved. Elapsed:0.045 Oct 16 01:00:31.197615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'199a6a07-ef81-454a-9a90-e16388fd8068'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:31.199346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '199a6a07-ef81-454a-9a90-e16388fd8068', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '199a6a07-ef81-454a-9a90-e16388fd8068', 'mac_address': 'fa:16:3e:86:96:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.169'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:31.219929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 199a6a07-ef81-454a-9a90-e16388fd8068 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:31.220660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 199a6a07-ef81-454a-9a90-e16388fd8068 updated. Details: {'device': '199a6a07-ef81-454a-9a90-e16388fd8068', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '199a6a07-ef81-454a-9a90-e16388fd8068', 'mac_address': 'fa:16:3e:86:96:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.169'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:00:31.231442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-199a6a07-ef, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:31.232013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-199a6a07-ef, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:31.233800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-199a6a07-ef, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:31.234333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:31.239581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-199a6a07-ef, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:31.240286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:31.244229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e22,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:31.245101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:332 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 24 devices currently available. Time elapsed: 0.047 Oct 16 01:00:31.246184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:31.247407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:31.251457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:31.252683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:31.274426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:31.366215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a41093-42ec-45fb-b1d3-b98227f857d3]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:31.366884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:332 - agent port security group processed in 0.169 Oct 16 01:00:31.368384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 199a6a07-ef81-454a-9a90-e16388fd8068 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:31.664723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['199a6a07-ef81-454a-9a90-e16388fd8068'] and devices down [] completed. Oct 16 01:00:31.666431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:332 - ports processed. Elapsed:0.515 Oct 16 01:00:31.666995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.516 Oct 16 01:00:31.674985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7082b04-e623-456d-b718-db0bf188daa5 None None] Resource Port 02def970-29eb-4148-a20d-445ed75d4fe8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=02def970-29eb-4148-a20d-445ed75d4fe8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=02def970-29eb-4148-a20d-445ed75d4fe8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:31.675675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7082b04-e623-456d-b718-db0bf188daa5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (02def970-29eb-4148-a20d-445ed75d4fe8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:32.052324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7082b04-e623-456d-b718-db0bf188daa5 None None] Resource Port 02def970-29eb-4148-a20d-445ed75d4fe8 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=02def970-29eb-4148-a20d-445ed75d4fe8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=02def970-29eb-4148-a20d-445ed75d4fe8,segment=NetworkSegment(eed8e0e7-4394-47d2-b07b-185558efbf1c),segment_id=eed8e0e7-4394-47d2-b07b-185558efbf1c)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=02def970-29eb-4148-a20d-445ed75d4fe8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:32.052717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7082b04-e623-456d-b718-db0bf188daa5 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (02def970-29eb-4148-a20d-445ed75d4fe8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:32.669706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9360f9f2-489e-4fef-b95f-d937e35dfc65","insert","qr-02def970-29",["set",[]],["map",[["attached-mac","fa:16:3e:c3:6f:49"],["iface-id","02def970-29eb-4148-a20d-445ed75d4fe8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:32.689976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9360f9f2-489e-4fef-b95f-d937e35dfc65","old",null,["set",[]],null],["","new","qr-02def970-29",29,["map",[["attached-mac","fa:16:3e:c3:6f:49"],["iface-id","02def970-29eb-4148-a20d-445ed75d4fe8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:00:33.153024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:333 started Oct 16 01:00:33.161152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e24,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=799000000,duration_sec=699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:33.170149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:33.170149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.014 Oct 16 01:00:33.170485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:33.174725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.022 Oct 16 01:00:33.175186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'02def970-29eb-4148-a20d-445ed75d4fe8'}, 'removed': set(), 'updated': {'02def970-29eb-4148-a20d-445ed75d4fe8'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:33.175874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '02def970-29eb-4148-a20d-445ed75d4fe8', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': '02def970-29eb-4148-a20d-445ed75d4fe8', 'mac_address': 'fa:16:3e:c3:6f:49', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:33.180355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 02def970-29eb-4148-a20d-445ed75d4fe8 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:33.180763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 02def970-29eb-4148-a20d-445ed75d4fe8 updated. Details: {'device': '02def970-29eb-4148-a20d-445ed75d4fe8', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': '02def970-29eb-4148-a20d-445ed75d4fe8', 'mac_address': 'fa:16:3e:c3:6f:49', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 16 01:00:33.181853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-02def970-29, col_values=(('tag', 11),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:33.182346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-02def970-29, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:33.182842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-02def970-29, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:33.192501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-02def970-29, col_values=(('other_config', {'net_uuid': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '374'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:33.201606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e26,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:33.202234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:333 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.027 Oct 16 01:00:33.202771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:00:33.203294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'02def970-29eb-4148-a20d-445ed75d4fe8'} Oct 16 01:00:33.204558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:33.204856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:33.210545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:33.250926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cdad7d-0677-49f4-9af1-a7b4a748ee8d]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:33.251985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:333 - agent port security group processed in 0.076 Oct 16 01:00:33.253099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 02def970-29eb-4148-a20d-445ed75d4fe8 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:33.516463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['02def970-29eb-4148-a20d-445ed75d4fe8'] and devices down [] completed. Oct 16 01:00:33.519448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:333 - ports processed. Elapsed:0.364 Oct 16 01:00:33.519894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.367 Oct 16 01:00:33.643630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 02def970-29eb-4148-a20d-445ed75d4fe8 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:33.644027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (02def970-29eb-4148-a20d-445ed75d4fe8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:35.154578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:334 started Oct 16 01:00:35.157500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e28,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=800000000,duration_sec=701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:35.158678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:35.159122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:334 - starting polling. Elapsed:0.005 Oct 16 01:00:35.162270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:35.167014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:334 - port information retrieved. Elapsed:0.013 Oct 16 01:00:35.167364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'02def970-29eb-4148-a20d-445ed75d4fe8'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:00:35.167907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '02def970-29eb-4148-a20d-445ed75d4fe8', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': '02def970-29eb-4148-a20d-445ed75d4fe8', 'mac_address': 'fa:16:3e:c3:6f:49', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:00:35.172031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 02def970-29eb-4148-a20d-445ed75d4fe8 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:00:35.172547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 02def970-29eb-4148-a20d-445ed75d4fe8 updated. Details: {'device': '02def970-29eb-4148-a20d-445ed75d4fe8', 'device_id': '87c7cd1b-9c6d-43e1-b9fe-14e8a32943eb', 'network_id': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'port_id': '02def970-29eb-4148-a20d-445ed75d4fe8', 'mac_address': 'fa:16:3e:c3:6f:49', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 374, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'de7a33c4-ae37-49e1-aede-5b4993e82cff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Oct 16 01:00:35.173628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-02def970-29, col_values=(('tag', 11),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:35.174054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-02def970-29, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:35.174613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-02def970-29, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:35.175157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:35.176076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-02def970-29, col_values=(('other_config', {'net_uuid': 'b461444f-0415-4655-b84a-88bf01b40b1a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '374', 'tag': '11'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:00:35.177003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:00:35.182752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e2a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:35.183431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:334 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.016 Oct 16 01:00:35.183953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:00:35.184410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:00:35.185773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:00:35.186237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:00:35.191824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:00:35.230530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312851b-d9f9-4da2-adfd-18ad334eb21b]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:00:35.231245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:334 - agent port security group processed in 0.064 Oct 16 01:00:35.232127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 02def970-29eb-4148-a20d-445ed75d4fe8 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:00:35.368557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['02def970-29eb-4148-a20d-445ed75d4fe8'] and devices down [] completed. Oct 16 01:00:35.369019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:334 - ports processed. Elapsed:0.215 Oct 16 01:00:35.369457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.215 Oct 16 01:00:36.499166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-79078b18-fa10-4495-a73b-1f893d99ecd7 tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Resource Port deleted: 70199f9c-b3b8-489f-9600-44bd5461aa30 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:36.499798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-79078b18-fa10-4495-a73b-1f893d99ecd7 tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (70199f9c-b3b8-489f-9600-44bd5461aa30), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:36.500151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-79078b18-fa10-4495-a73b-1f893d99ecd7 tempest-VolumesActionsTest-1926541035 tempest-VolumesActionsTest-1926541035-project] Security group member updated {'fb55519e-722d-49f4-9a24-42b82b48aa56'} Oct 16 01:00:37.155574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:335 started Oct 16 01:00:37.158376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=801000000,duration_sec=703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:37.159188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:37.159691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:335 - starting polling. Elapsed:0.004 Oct 16 01:00:37.165642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:37.168727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 70199f9c-b3b8-489f-9600-44bd5461aa30 not present in bridge br-int Oct 16 01:00:37.169711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:00:37.170179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['70199f9c-b3b8-489f-9600-44bd5461aa30'] Oct 16 01:00:37.170788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 70199f9c-b3b8-489f-9600-44bd5461aa30 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:00:37.175892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:335 - port information retrieved. Elapsed:0.020 Oct 16 01:00:37.176470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Oct 16 01:00:37.845464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0486feae-cb9f-4b04-96ba-c385ee66fcbc tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:37Z,data_plane_status=None,description='',device_id='e232da69-f419-4e6d-802e-a253ad2587ab',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1cc7e38e-e043-419a-986d-342c38dba97f,mac_address=fa:16:3e:d6:4b:6c,name='',network_id=67400858-429f-4052-a9a5-3012690406d5,numa_affinity_policy=,project_id='cb1743385ea14cc39244c83e8fc88e7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1cc7e38e-e043-419a-986d-342c38dba97f),security_group_ids=set([04a6f405-fb32-4245-a68e-14ecec65861c]),status='DOWN',updated_at=2022-10-16T01:00:37Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:37.846179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0486feae-cb9f-4b04-96ba-c385ee66fcbc tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1cc7e38e-e043-419a-986d-342c38dba97f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:37.846343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0486feae-cb9f-4b04-96ba-c385ee66fcbc tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group member updated {'04a6f405-fb32-4245-a68e-14ecec65861c'} Oct 16 01:00:38.363022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88150590-c7a4-4d30-8c33-337dcc4c1733 service neutron] Resource Port 1cc7e38e-e043-419a-986d-342c38dba97f updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=1cc7e38e-e043-419a-986d-342c38dba97f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=1cc7e38e-e043-419a-986d-342c38dba97f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:38.363351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88150590-c7a4-4d30-8c33-337dcc4c1733 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1cc7e38e-e043-419a-986d-342c38dba97f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:38.835042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-88150590-c7a4-4d30-8c33-337dcc4c1733 service neutron] Resource Port 1cc7e38e-e043-419a-986d-342c38dba97f updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=1cc7e38e-e043-419a-986d-342c38dba97f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1cc7e38e-e043-419a-986d-342c38dba97f,segment=NetworkSegment(e85c3ee2-f8b6-42c0-8def-930e36cc19ac),segment_id=e85c3ee2-f8b6-42c0-8def-930e36cc19ac)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=1cc7e38e-e043-419a-986d-342c38dba97f,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:38.835500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-88150590-c7a4-4d30-8c33-337dcc4c1733 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1cc7e38e-e043-419a-986d-342c38dba97f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:39.156557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:336 started Oct 16 01:00:39.159274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=802000000,duration_sec=705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:39.159875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:39.160280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.004 Oct 16 01:00:39.164485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:39.173784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.017 Oct 16 01:00:39.174290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 16 01:00:41.157962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:337 started Oct 16 01:00:41.160867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=803000000,duration_sec=707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:41.161294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:41.161657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:00:43.159065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:338 started Oct 16 01:00:43.161495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=805000000,duration_sec=709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:43.162065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:43.162421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:00:45.160762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:339 started Oct 16 01:00:45.166071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=807000000,duration_sec=711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:45.166793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:45.167247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 01:00:47.162188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:340 started Oct 16 01:00:47.166908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e36,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=809000000,duration_sec=713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:47.167789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:47.168448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 01:00:49.163836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:341 started Oct 16 01:00:49.169295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e38,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=810000000,duration_sec=715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:49.170049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:49.170595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 01:00:49.910195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 1cc7e38e-e043-419a-986d-342c38dba97f updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:49.911616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1cc7e38e-e043-419a-986d-342c38dba97f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:51.175200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:342 started Oct 16 01:00:51.175200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e3a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=811000000,duration_sec=717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:51.175200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:51.175200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:342 - starting polling. Elapsed:0.005 Oct 16 01:00:51.176685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:51.190505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:342 - port information retrieved. Elapsed:0.020 Oct 16 01:00:51.191475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Oct 16 01:00:52.373870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 1cc7e38e-e043-419a-986d-342c38dba97f updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:52.375250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1cc7e38e-e043-419a-986d-342c38dba97f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:52.584075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:52.584715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:52.697248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9f4f7d5a-101e-4840-8082-d845f864a1a6 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: 4827324a-a969-452f-85b3-109a32799305 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:52.697736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9f4f7d5a-101e-4840-8082-d845f864a1a6 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (4827324a-a969-452f-85b3-109a32799305), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:52.698223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9f4f7d5a-101e-4840-8082-d845f864a1a6 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'eb457691-a9eb-4082-a592-2cdc7a5714ed'} Oct 16 01:00:53.166659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:343 started Oct 16 01:00:53.169676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e3c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=812000000,duration_sec=719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:53.170530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:53.171119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:343 - starting polling. Elapsed:0.005 Oct 16 01:00:53.174458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:53.194924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4827324a-a969-452f-85b3-109a32799305 not present in bridge br-int Oct 16 01:00:53.197157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:00:53.198898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['4827324a-a969-452f-85b3-109a32799305'] Oct 16 01:00:53.199742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4827324a-a969-452f-85b3-109a32799305 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:00:53.218746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:343 - port information retrieved. Elapsed:0.052 Oct 16 01:00:53.220582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.054 Oct 16 01:00:54.378067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b48ae257-e314-4eb5-b078-48282d776909 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:53Z,data_plane_status=None,description='',device_id='2f92209b-6feb-4e65-af10-6872f24bbc95',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a16383c6-9bce-4108-ad57-fad77bb41e2b,mac_address=fa:16:3e:db:87:ca,name='',network_id=aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae,numa_affinity_policy=,project_id='ed24cab62e1f4810a10e7ba36fcbeadb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a16383c6-9bce-4108-ad57-fad77bb41e2b),security_group_ids=set([0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9]),status='DOWN',updated_at=2022-10-16T01:00:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:54.379542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b48ae257-e314-4eb5-b078-48282d776909 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:54.380301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b48ae257-e314-4eb5-b078-48282d776909 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group member updated {'0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'} Oct 16 01:00:54.590238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 9f15f027-a9c6-4298-a989-336905ee5a12 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:54.591909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:55.168419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:344 started Oct 16 01:00:55.171305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=814000000,duration_sec=721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:55.171906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:55.172252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:344 - starting polling. Elapsed:0.004 Oct 16 01:00:55.175597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:55.190753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:344 - port information retrieved. Elapsed:0.020 Oct 16 01:00:55.191146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Oct 16 01:00:55.532267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3d6faaa-dc18-47d6-b791-3ec0eeb8de2e service neutron] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=a16383c6-9bce-4108-ad57-fad77bb41e2b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=a16383c6-9bce-4108-ad57-fad77bb41e2b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:55.532891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3d6faaa-dc18-47d6-b791-3ec0eeb8de2e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:56.508437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3d6faaa-dc18-47d6-b791-3ec0eeb8de2e service neutron] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=a16383c6-9bce-4108-ad57-fad77bb41e2b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a16383c6-9bce-4108-ad57-fad77bb41e2b,segment=NetworkSegment(2d088789-908c-4e34-9f6c-bb4e4f096ea2),segment_id=2d088789-908c-4e34-9f6c-bb4e4f096ea2)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=a16383c6-9bce-4108-ad57-fad77bb41e2b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:56.508851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3d6faaa-dc18-47d6-b791-3ec0eeb8de2e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.009891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84d75f6d-7d4c-44e4-9425-9168f2890f2d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:00:56Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1f2f9447-5a26-405e-829d-d6cb41d3ad8d,mac_address=fa:16:3e:90:4e:83,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1f2f9447-5a26-405e-829d-d6cb41d3ad8d),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:00:56Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:00:57.011110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84d75f6d-7d4c-44e4-9425-9168f2890f2d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1f2f9447-5a26-405e-829d-d6cb41d3ad8d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.166038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroup deleted: eb457691-a9eb-4082-a592-2cdc7a5714ed {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:57.166485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (eb457691-a9eb-4082-a592-2cdc7a5714ed), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.167120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('eb457691-a9eb-4082-a592-2cdc7a5714ed',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:00:57.214127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:345 started Oct 16 01:00:57.214795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('eb457691-a9eb-4082-a592-2cdc7a5714ed',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:00:57.219479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 84405510-ca07-4d81-a8f3-99ba20fc8bb3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:57.219921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (84405510-ca07-4d81-a8f3-99ba20fc8bb3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.220268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 01:00:57.223755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 8f5c372e-a39d-4dcd-83b6-84abe1754704 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:57.224152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8f5c372e-a39d-4dcd-83b6-84abe1754704), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.224491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 01:00:57.224881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 996714b7-8bde-4d1a-82d6-8f59cb06fb82 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:57.225235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (996714b7-8bde-4d1a-82d6-8f59cb06fb82), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.232216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 01:00:57.233289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 951d2955-88ef-493e-9914-da6a4e21ce44 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:57.233822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (951d2955-88ef-493e-9914-da6a4e21ce44), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.234334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dd6dba34-e34d-4d9f-b3ee-fb1fd0593547 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['eb457691-a9eb-4082-a592-2cdc7a5714ed'] Oct 16 01:00:57.239548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e40,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=881000000,duration_sec=723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:57.248584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:57.249155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:345 - starting polling. Elapsed:0.040 Oct 16 01:00:57.252379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:57.256981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:345 - port information retrieved. Elapsed:0.048 Oct 16 01:00:57.257525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.049 Oct 16 01:00:58.114623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2fe16796-c2b2-489c-949e-60d3d2c51654 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: b403988f-1d9b-4382-a370-00185d7b547d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:00:58.116296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2fe16796-c2b2-489c-949e-60d3d2c51654 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (b403988f-1d9b-4382-a370-00185d7b547d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:58.520566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84d75f6d-7d4c-44e4-9425-9168f2890f2d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port 1f2f9447-5a26-405e-829d-d6cb41d3ad8d updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'd926ffde-0f50-4837-b0ba-5d56b2473d35'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:00:58.521029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84d75f6d-7d4c-44e4-9425-9168f2890f2d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (1f2f9447-5a26-405e-829d-d6cb41d3ad8d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:59.210089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:346 started Oct 16 01:00:59.212716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=855000000,duration_sec=725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:00:59.213398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:00:59.213743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:346 - starting polling. Elapsed:0.004 Oct 16 01:00:59.217943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:00:59.220154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port b403988f-1d9b-4382-a370-00185d7b547d not present in bridge br-int Oct 16 01:00:59.220512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:00:59.220802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['b403988f-1d9b-4382-a370-00185d7b547d'] Oct 16 01:00:59.221389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port b403988f-1d9b-4382-a370-00185d7b547d is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:00:59.225982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:346 - port information retrieved. Elapsed:0.016 Oct 16 01:00:59.226555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 16 01:01:01.212423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:347 started Oct 16 01:01:01.216622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e44,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=859000000,duration_sec=727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:01.217340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:01.217749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 01:01:03.212895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:348 started Oct 16 01:01:03.218506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e46,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=861000000,duration_sec=729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:03.219457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:03.219997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 01:01:03.364670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b5253ef9-dc6a-40fb-8aec-5fc8e184b2bb tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: ae364987-4db0-45e9-8b32-48163c845492 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:03.365052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b5253ef9-dc6a-40fb-8aec-5fc8e184b2bb tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (ae364987-4db0-45e9-8b32-48163c845492), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:03.365869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b5253ef9-dc6a-40fb-8aec-5fc8e184b2bb tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'0aa46afa-7cf8-4516-97b1-1f6d9484df92'} Oct 16 01:01:05.214387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:349 started Oct 16 01:01:05.219050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e48,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=861000000,duration_sec=731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:05.219717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:05.220125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:349 - starting polling. Elapsed:0.006 Oct 16 01:01:05.223308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:05.225553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ae364987-4db0-45e9-8b32-48163c845492 not present in bridge br-int Oct 16 01:01:05.225901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:01:05.226899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['ae364987-4db0-45e9-8b32-48163c845492'] Oct 16 01:01:05.227250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ae364987-4db0-45e9-8b32-48163c845492 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:01:05.231669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:349 - port information retrieved. Elapsed:0.017 Oct 16 01:01:05.232018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 16 01:01:05.560606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroup deleted: 0aa46afa-7cf8-4516-97b1-1f6d9484df92 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:05.561838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (0aa46afa-7cf8-4516-97b1-1f6d9484df92), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:05.562392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0aa46afa-7cf8-4516-97b1-1f6d9484df92',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:01:05.579314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0aa46afa-7cf8-4516-97b1-1f6d9484df92',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:01:05.579962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 1c94e101-b1a3-4aaf-ab10-3b01c8f520bf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:05.580458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1c94e101-b1a3-4aaf-ab10-3b01c8f520bf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:05.581019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 01:01:05.581549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: b1c1ce1e-78cd-4c92-9e60-295cc70ff3a9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:05.582112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b1c1ce1e-78cd-4c92-9e60-295cc70ff3a9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:05.582433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 01:01:05.582947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 6466298f-835c-4a28-95f2-a901b7a26cef {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:05.583572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6466298f-835c-4a28-95f2-a901b7a26cef), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:05.584166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 01:01:05.584733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 90d74311-4dce-4798-a304-3882de5fcc8d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:05.585345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (90d74311-4dce-4798-a304-3882de5fcc8d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:05.587121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0d0c503e-b807-41f8-b90e-bc2026de1986 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['0aa46afa-7cf8-4516-97b1-1f6d9484df92'] Oct 16 01:01:05.872187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:05.872661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.285838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-992ad62b-9c1c-4a90-83c9-55e1ccfe1475 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:06.287184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-992ad62b-9c1c-4a90-83c9-55e1ccfe1475 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.586299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:01:06Z,description='tempest-description--2130321799',id=f5484aef-779d-4d62-a0b7-8316aca70412,is_default=False,name='tempest-securitygroup--1615976990',project_id='fb3c758e27684dcd9265e2d60036d80b',revision_number=1,rules=[SecurityGroupRule(7562e087-c6d5-47b9-ac84-f2ec8db10ef5),SecurityGroupRule(c89ad12f-848d-4451-91bf-85cc3290561c)],shared=False,stateful=True,updated_at=2022-10-16T01:01:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:06.586476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (f5484aef-779d-4d62-a0b7-8316aca70412), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.587118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:06Z,description=,direction='egress',ethertype='IPv4',id=7562e087-c6d5-47b9-ac84-f2ec8db10ef5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f5484aef-779d-4d62-a0b7-8316aca70412,updated_at=2022-10-16T01:01:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:06.587491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7562e087-c6d5-47b9-ac84-f2ec8db10ef5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.587864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:01:06.588547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:06Z,description=,direction='egress',ethertype='IPv6',id=c89ad12f-848d-4451-91bf-85cc3290561c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f5484aef-779d-4d62-a0b7-8316aca70412,updated_at=2022-10-16T01:01:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:06.588910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c89ad12f-848d-4451-91bf-85cc3290561c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.589248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-810bec07-e762-47a6-93b2-06d2412b5452 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:01:06.699899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f50bbbef-a421-418f-ac81-691b2d29dd9a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:06Z,description='',direction='ingress',ethertype='IPv4',id=ea084f5d-a316-4761-acdf-1e4b3a31d6a1,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f5484aef-779d-4d62-a0b7-8316aca70412,updated_at=2022-10-16T01:01:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:06.700290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f50bbbef-a421-418f-ac81-691b2d29dd9a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ea084f5d-a316-4761-acdf-1e4b3a31d6a1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.700812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f50bbbef-a421-418f-ac81-691b2d29dd9a tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:01:06.829442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77d5c14b-f452-4e22-b070-2c56f5eb8d1e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:06Z,description='',direction='ingress',ethertype='IPv4',id=2e8b8bc7-ca13-43a6-bdfd-ab7c1cd90b23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f5484aef-779d-4d62-a0b7-8316aca70412,updated_at=2022-10-16T01:01:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:06.830011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77d5c14b-f452-4e22-b070-2c56f5eb8d1e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2e8b8bc7-ca13-43a6-bdfd-ab7c1cd90b23), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:06.830660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77d5c14b-f452-4e22-b070-2c56f5eb8d1e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:01:06.978107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d05898f1-9435-498a-a2e8-7cd468305e20 admin admin] Resource Subnet deleted: 984308e5-babb-4c21-813e-335d2229fcf9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:06.978933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d05898f1-9435-498a-a2e8-7cd468305e20 admin admin] Publish callbacks [] for Subnet (984308e5-babb-4c21-813e-335d2229fcf9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.216620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:350 started Oct 16 01:01:07.219592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e4a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=862000000,duration_sec=733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:07.220526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:07.221105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:350 - starting polling. Elapsed:0.006 Oct 16 01:01:07.224750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.240800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e not present in bridge br-int Oct 16 01:01:07.241813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:01:07.242464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e'] Oct 16 01:01:07.243944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ed9dbc82-f3ef-41ad-8c02-ac200b34ce0e is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:01:07.252494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:350 - port information retrieved. Elapsed:0.038 Oct 16 01:01:07.253046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.038 Oct 16 01:01:07.275510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d735f103-27ac-4740-8a29-b5668512b62e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:06Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=41018b25-ef72-4267-9902-28254b241fb5,mac_address=fa:16:3e:10:53:8b,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(41018b25-ef72-4267-9902-28254b241fb5),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:01:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:07.275905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d735f103-27ac-4740-8a29-b5668512b62e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (41018b25-ef72-4267-9902-28254b241fb5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.309507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2735f29a-20aa-47bf-900e-212918a24ae8 admin admin] Resource Network deleted: 2990507f-5171-4eb8-ae44-3866cf4c43a9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:07.310621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2735f29a-20aa-47bf-900e-212918a24ae8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (2990507f-5171-4eb8-ae44-3866cf4c43a9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.660619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d735f103-27ac-4740-8a29-b5668512b62e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port 41018b25-ef72-4267-9902-28254b241fb5 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '57124b50-0f21-4002-a6dc-2ef37b9e8da3'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:07.661135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d735f103-27ac-4740-8a29-b5668512b62e tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (41018b25-ef72-4267-9902-28254b241fb5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.712886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Resource SecurityGroup deleted: fb55519e-722d-49f4-9a24-42b82b48aa56 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:07.713880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (fb55519e-722d-49f4-9a24-42b82b48aa56), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.714484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fb55519e-722d-49f4-9a24-42b82b48aa56',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:01:07.768294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fb55519e-722d-49f4-9a24-42b82b48aa56',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:01:07.769695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Resource SecurityGroupRule deleted: 38f0a2a2-1263-4d1a-8ab5-9a26aa9e8dde {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:07.771066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (38f0a2a2-1263-4d1a-8ab5-9a26aa9e8dde), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.771725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 01:01:07.772295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Resource SecurityGroupRule deleted: 390ae929-a96b-4292-b633-6bfef094e67a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:07.773726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (390ae929-a96b-4292-b633-6bfef094e67a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.774483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 01:01:07.775095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Resource SecurityGroupRule deleted: b06b5c99-0512-4397-bf1a-cafd3f96c418 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:07.776103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b06b5c99-0512-4397-bf1a-cafd3f96c418), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.776784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 01:01:07.777172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Resource SecurityGroupRule deleted: c3ab0159-2ef2-4e60-8dbd-c7558b1277df {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:07.777732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c3ab0159-2ef2-4e60-8dbd-c7558b1277df), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:07.778505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ca9011a8-9b2f-4436-8a1d-70bda43ca890 admin admin] Security group rule updated ['fb55519e-722d-49f4-9a24-42b82b48aa56'] Oct 16 01:01:07.897136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:07.897752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:08.871134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:01:08Z,description='Default security group',id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,is_default=True,name='default',project_id='343c019304314c669a3381cc4c68e481',revision_number=1,rules=[SecurityGroupRule(027c1e85-7cde-48d0-8747-4b9fc9000bba),SecurityGroupRule(0388f61f-e7b7-4a25-9a2a-7ee534b2cf2c),SecurityGroupRule(38105740-3bc2-4c5e-a316-a02091f30ad9),SecurityGroupRule(6cbf519b-f37b-492f-8b80-8e5585c5ffce)],shared=False,stateful=True,updated_at=2022-10-16T01:01:08Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:08.871766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (55d9e52b-b53a-433b-b3a4-a72e6e3f2b56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:08.872157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:08Z,description=,direction='egress',ethertype='IPv6',id=027c1e85-7cde-48d0-8747-4b9fc9000bba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,updated_at=2022-10-16T01:01:08Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:08.872528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (027c1e85-7cde-48d0-8747-4b9fc9000bba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:08.872868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:01:08.873564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:08Z,description=,direction='ingress',ethertype='IPv4',id=0388f61f-e7b7-4a25-9a2a-7ee534b2cf2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol=,remote_address_group_id=,remote_group_id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,remote_ip_prefix=,revision_number=0,security_group_id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,updated_at=2022-10-16T01:01:08Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:08.873916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0388f61f-e7b7-4a25-9a2a-7ee534b2cf2c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:08.874247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:01:08.874936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:08Z,description=,direction='ingress',ethertype='IPv6',id=38105740-3bc2-4c5e-a316-a02091f30ad9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol=,remote_address_group_id=,remote_group_id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,remote_ip_prefix=,revision_number=0,security_group_id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,updated_at=2022-10-16T01:01:08Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:08.875296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (38105740-3bc2-4c5e-a316-a02091f30ad9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:08.875650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:01:08.876342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:08Z,description=,direction='egress',ethertype='IPv4',id=6cbf519b-f37b-492f-8b80-8e5585c5ffce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=55d9e52b-b53a-433b-b3a4-a72e6e3f2b56,updated_at=2022-10-16T01:01:08Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:08.876696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6cbf519b-f37b-492f-8b80-8e5585c5ffce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:08.877032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:01:09.020576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T01:01:08Z,description='',dns_domain=None,id=3e12ae87-77ee-4d05-8dce-be1b6f55d51c,mtu=1500,name='tempest-TestMinimumBasicScenario-63270364-network',project_id='343c019304314c669a3381cc4c68e481',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3e12ae87-77ee-4d05-8dce-be1b6f55d51c),segments=[NetworkSegment(74a0e3b5-1b19-4bfa-b460-92448029b4bb)],shared=False,status='ACTIVE',updated_at=2022-10-16T01:01:08Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:09.021088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (3e12ae87-77ee-4d05-8dce-be1b6f55d51c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:09.215767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:351 started Oct 16 01:01:09.218585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=861000000,duration_sec=735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:09.219234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:09.219583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:351 - starting polling. Elapsed:0.004 Oct 16 01:01:09.222897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:09.230351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:351 - port information retrieved. Elapsed:0.015 Oct 16 01:01:09.230706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-31326e9a-5ecc-4c8e-9309-a2037e621b6c admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3e12ae87-77ee-4d05-8dce-be1b6f55d51c with segmentation id not found. Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 01:01:09.249167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 01:01:09.250251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 01:01:09.250251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 01:01:09.250251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 01:01:09.250251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3e12ae87-77ee-4d05-8dce-be1b6f55d51c with segmentation id not found. Oct 16 01:01:09.250251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 01:01:09.323351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-211a8014-0a7c-4138-a49b-7e39d3373b52 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(2ad2de63-f3f8-4b71-a6f4-7b958a4811e5)],cidr=172.20.0.0/28,created_at=2022-10-16T01:01:09Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=9efd72bb-10d0-4ec3-88df-b489c0a0e472,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-63270364-subnet',network_id=3e12ae87-77ee-4d05-8dce-be1b6f55d51c,project_id='343c019304314c669a3381cc4c68e481',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T01:01:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:09.324585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-211a8014-0a7c-4138-a49b-7e39d3373b52 admin admin] Publish callbacks [] for Subnet (9efd72bb-10d0-4ec3-88df-b489c0a0e472), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:09.914261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-957fa400-5f06-4b96-8ac7-273b213c1581 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:09Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e12ae87-77ee-4d05-8dce-be1b6f55d51c',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4be31983-76fd-4267-b2a1-c5cf8c2a29ba,mac_address=fa:16:3e:43:11:9a,name='',network_id=3e12ae87-77ee-4d05-8dce-be1b6f55d51c,numa_affinity_policy=,project_id='343c019304314c669a3381cc4c68e481',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4be31983-76fd-4267-b2a1-c5cf8c2a29ba),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:09.916304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-957fa400-5f06-4b96-8ac7-273b213c1581 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4be31983-76fd-4267-b2a1-c5cf8c2a29ba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:10.259462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-957fa400-5f06-4b96-8ac7-273b213c1581 None None] Resource Port 4be31983-76fd-4267-b2a1-c5cf8c2a29ba updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4be31983-76fd-4267-b2a1-c5cf8c2a29ba,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4be31983-76fd-4267-b2a1-c5cf8c2a29ba,segment=NetworkSegment(74a0e3b5-1b19-4bfa-b460-92448029b4bb),segment_id=74a0e3b5-1b19-4bfa-b460-92448029b4bb)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4be31983-76fd-4267-b2a1-c5cf8c2a29ba,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:10.259865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-957fa400-5f06-4b96-8ac7-273b213c1581 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4be31983-76fd-4267-b2a1-c5cf8c2a29ba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:10.381201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["778393bd-a1fe-4404-90dc-0c5ca06c13a9","insert","tap4be31983-76",["set",[]],["map",[["attached-mac","fa:16:3e:43:11:9a"],["iface-id","4be31983-76fd-4267-b2a1-c5cf8c2a29ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:10.415036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["778393bd-a1fe-4404-90dc-0c5ca06c13a9","old",null,["set",[]],null],["","new","tap4be31983-76",30,["map",[["attached-mac","fa:16:3e:43:11:9a"],["iface-id","4be31983-76fd-4267-b2a1-c5cf8c2a29ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:10.470198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7ebc663a-914b-4b8f-a3cb-a3f5b4e816e8 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:09Z,data_plane_status=None,description='',device_id='72e98af7-ae6e-4be9-83da-b23277f8f803',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,mac_address=fa:16:3e:2f:57:97,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9c8df3fc-5ba4-4d5b-a201-b5269c461008),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:10.470715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7ebc663a-914b-4b8f-a3cb-a3f5b4e816e8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9c8df3fc-5ba4-4d5b-a201-b5269c461008), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:11.216896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:352 started Oct 16 01:01:11.219547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=862000000,duration_sec=737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:11.220368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:11.220949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:352 - starting polling. Elapsed:0.004 Oct 16 01:01:11.224803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:11.230562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:352 - port information retrieved. Elapsed:0.014 Oct 16 01:01:11.231284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'4be31983-76fd-4267-b2a1-c5cf8c2a29ba'}, 'removed': set(), 'updated': {'4be31983-76fd-4267-b2a1-c5cf8c2a29ba'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:11.232153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'mac_address': 'fa:16:3e:43:11:9a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:11.237079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 4be31983-76fd-4267-b2a1-c5cf8c2a29ba {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:11.237691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4be31983-76fd-4267-b2a1-c5cf8c2a29ba updated. Details: {'device': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'mac_address': 'fa:16:3e:43:11:9a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 01:01:11.238126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 12 as local vlan for net-id=3e12ae87-77ee-4d05-8dce-be1b6f55d51c, seg-id=390 Oct 16 01:01:11.245500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c95,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4486), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:11.248831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416e50,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4486}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:11.250150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4be31983-76, col_values=(('tag', 12),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:11.250804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap4be31983-76, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:11.251469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap4be31983-76, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:11.260631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4be31983-76, col_values=(('other_config', {'net_uuid': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '390'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:11.270830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e52,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:11.271375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:352 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 26 devices currently available. Time elapsed: 0.039 Oct 16 01:01:11.271857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:01:11.272418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'4be31983-76fd-4267-b2a1-c5cf8c2a29ba'} Oct 16 01:01:11.274398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:11.278169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:11.289448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:11.347820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75de9d0-f83e-4f85-90e8-8db52bed6dec]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:11.349257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:352 - agent port security group processed in 0.117 Oct 16 01:01:11.350712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 4be31983-76fd-4267-b2a1-c5cf8c2a29ba to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:11.542519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a07aa95-8bde-439f-a33b-983c0bf3f440 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:11Z,data_plane_status=None,description='',device_id='0c861342-ab71-4ab6-bed1-41f3b6e38853',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=35e81c79-fcfc-45cc-82e6-d74a12d99947,mac_address=fa:16:3e:88:69:9f,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(35e81c79-fcfc-45cc-82e6-d74a12d99947),security_group_ids=set([f5484aef-779d-4d62-a0b7-8316aca70412]),status='DOWN',updated_at=2022-10-16T01:01:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:11.543033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5a07aa95-8bde-439f-a33b-983c0bf3f440 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (35e81c79-fcfc-45cc-82e6-d74a12d99947), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:11.543746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5a07aa95-8bde-439f-a33b-983c0bf3f440 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'f5484aef-779d-4d62-a0b7-8316aca70412'} Oct 16 01:01:11.746450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['4be31983-76fd-4267-b2a1-c5cf8c2a29ba'] and devices down [] completed. Oct 16 01:01:11.747150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:352 - ports processed. Elapsed:0.530 Oct 16 01:01:11.747771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.531 Oct 16 01:01:11.860931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 4be31983-76fd-4267-b2a1-c5cf8c2a29ba updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:11.861599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4be31983-76fd-4267-b2a1-c5cf8c2a29ba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:12.031965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-988cdf1f-acc7-45c6-b954-b01a3e594989 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:11Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3f07f60b-d2b6-4758-8e13-af7cb046e538,mac_address=fa:16:3e:a4:16:57,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3f07f60b-d2b6-4758-8e13-af7cb046e538),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:01:11Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:12.033098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-988cdf1f-acc7-45c6-b954-b01a3e594989 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3f07f60b-d2b6-4758-8e13-af7cb046e538), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:12.266178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad670993-6b81-42ae-a664-980da0213662 service neutron] Resource Port 35e81c79-fcfc-45cc-82e6-d74a12d99947 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=35e81c79-fcfc-45cc-82e6-d74a12d99947,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=35e81c79-fcfc-45cc-82e6-d74a12d99947,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:12.268867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad670993-6b81-42ae-a664-980da0213662 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (35e81c79-fcfc-45cc-82e6-d74a12d99947), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:12.592641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad670993-6b81-42ae-a664-980da0213662 service neutron] Resource Port 35e81c79-fcfc-45cc-82e6-d74a12d99947 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=35e81c79-fcfc-45cc-82e6-d74a12d99947,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=35e81c79-fcfc-45cc-82e6-d74a12d99947,segment=NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565),segment_id=994bcd7f-d2ee-4126-bfcb-b7cd5780c565)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=35e81c79-fcfc-45cc-82e6-d74a12d99947,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:12.593319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad670993-6b81-42ae-a664-980da0213662 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (35e81c79-fcfc-45cc-82e6-d74a12d99947), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:12.975008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06db3f59-c4bf-46b5-940d-a27dc74a7d79 None None] Resource Port 9c8df3fc-5ba4-4d5b-a201-b5269c461008 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:12.975671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06db3f59-c4bf-46b5-940d-a27dc74a7d79 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9c8df3fc-5ba4-4d5b-a201-b5269c461008), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:13.169588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06db3f59-c4bf-46b5-940d-a27dc74a7d79 None None] Resource Port 9c8df3fc-5ba4-4d5b-a201-b5269c461008 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:13.170898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06db3f59-c4bf-46b5-940d-a27dc74a7d79 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9c8df3fc-5ba4-4d5b-a201-b5269c461008), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:13.201966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-988cdf1f-acc7-45c6-b954-b01a3e594989 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource Port 3f07f60b-d2b6-4758-8e13-af7cb046e538 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '5af09df3-c330-4dd9-aa5c-179621b36f7a'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:13.202441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-988cdf1f-acc7-45c6-b954-b01a3e594989 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3f07f60b-d2b6-4758-8e13-af7cb046e538), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:13.218575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:353 started Oct 16 01:01:13.222204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=865000000,duration_sec=739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:13.223119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:13.224004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:353 - starting polling. Elapsed:0.005 Oct 16 01:01:13.232482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:13.243616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:353 - port information retrieved. Elapsed:0.025 Oct 16 01:01:13.244565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'4be31983-76fd-4267-b2a1-c5cf8c2a29ba'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:13.247294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'mac_address': 'fa:16:3e:43:11:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:13.257638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 4be31983-76fd-4267-b2a1-c5cf8c2a29ba {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:13.258773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4be31983-76fd-4267-b2a1-c5cf8c2a29ba updated. Details: {'device': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', 'mac_address': 'fa:16:3e:43:11:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 16 01:01:13.260912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4be31983-76, col_values=(('tag', 12),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:13.263254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap4be31983-76, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:13.275335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap4be31983-76, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:13.277569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:13.279321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap4be31983-76, col_values=(('other_config', {'net_uuid': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '390', 'tag': '12'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:13.280242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:13.282818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e56,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:13.283512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:353 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 26 devices currently available. Time elapsed: 0.038 Oct 16 01:01:13.284066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:01:13.284918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:01:13.286269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:13.286666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:13.292146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:13.339438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[07639324-d451-4b8e-9faa-6cf5168a664a]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:13.340158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:353 - agent port security group processed in 0.095 Oct 16 01:01:13.341103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 4be31983-76fd-4267-b2a1-c5cf8c2a29ba to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:13.666161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['4be31983-76fd-4267-b2a1-c5cf8c2a29ba'] and devices down [] completed. Oct 16 01:01:13.666654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:353 - ports processed. Elapsed:0.448 Oct 16 01:01:13.667383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.449 Oct 16 01:01:13.917461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9ec50932-3491-4f1c-9ab0-7f03cc31fb38","insert","qg-9c8df3fc-5b",["set",[]],["map",[["attached-mac","fa:16:3e:2f:57:97"],["iface-id","9c8df3fc-5ba4-4d5b-a201-b5269c461008"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:13.930513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9ec50932-3491-4f1c-9ab0-7f03cc31fb38","old",null,["set",[]],null],["","new","qg-9c8df3fc-5b",31,["map",[["attached-mac","fa:16:3e:2f:57:97"],["iface-id","9c8df3fc-5ba4-4d5b-a201-b5269c461008"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:14.011509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-af4b8ebc-baeb-4c1a-83a7-62e0dc6bcf64 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:13Z,data_plane_status=None,description='',device_id='72e98af7-ae6e-4be9-83da-b23277f8f803',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7d0732f2-b77d-4ee1-a9e9-7bf8e7736171,mac_address=fa:16:3e:05:1c:6f,name='',network_id=3e12ae87-77ee-4d05-8dce-be1b6f55d51c,numa_affinity_policy=,project_id='343c019304314c669a3381cc4c68e481',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7d0732f2-b77d-4ee1-a9e9-7bf8e7736171),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:13Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:14.013223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-af4b8ebc-baeb-4c1a-83a7-62e0dc6bcf64 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (7d0732f2-b77d-4ee1-a9e9-7bf8e7736171), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:14.653722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-af4b8ebc-baeb-4c1a-83a7-62e0dc6bcf64 admin admin] Received resource Port update without any changes: 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 01:01:15.219711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:354 started Oct 16 01:01:15.222897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=866000000,duration_sec=741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:15.223694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:15.224500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:354 - starting polling. Elapsed:0.005 Oct 16 01:01:15.230105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:15.235368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:354 - port information retrieved. Elapsed:0.016 Oct 16 01:01:15.235879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'9c8df3fc-5ba4-4d5b-a201-b5269c461008'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:15.236683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'mac_address': 'fa:16:3e:2f:57:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.143'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:15.241644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 9c8df3fc-5ba4-4d5b-a201-b5269c461008 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:15.242175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 9c8df3fc-5ba4-4d5b-a201-b5269c461008 updated. Details: {'device': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'mac_address': 'fa:16:3e:2f:57:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.143'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:01:15.252466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9c8df3fc-5b, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:15.253366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-9c8df3fc-5b, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:15.253488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-9c8df3fc-5b, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:15.262505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9c8df3fc-5b, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:15.274675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e5a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:15.275126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:354 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 27 devices currently available. Time elapsed: 0.039 Oct 16 01:01:15.275424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:01:15.275898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'9c8df3fc-5ba4-4d5b-a201-b5269c461008'} Oct 16 01:01:15.277208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:15.277757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:15.284855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:15.335692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b9e3b-90d4-4d0b-86f6-9306fdca0a6e]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:15.336580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:354 - agent port security group processed in 0.100 Oct 16 01:01:15.337493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 9c8df3fc-5ba4-4d5b-a201-b5269c461008 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:15.568967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['9c8df3fc-5ba4-4d5b-a201-b5269c461008'] and devices down [] completed. Oct 16 01:01:15.569264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:354 - ports processed. Elapsed:0.350 Oct 16 01:01:15.569641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.350 Oct 16 01:01:15.671408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 9c8df3fc-5ba4-4d5b-a201-b5269c461008 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9c8df3fc-5ba4-4d5b-a201-b5269c461008,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:15.672215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (9c8df3fc-5ba4-4d5b-a201-b5269c461008), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.046048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:01:15Z,description='Default security group',id=fb0998b3-74cd-4627-a1e8-57c2074611aa,is_default=True,name='default',project_id='07fd28660dad4acf93dc9785e33d2366',revision_number=1,rules=[SecurityGroupRule(576f33dc-45cd-47d1-bd7a-2ac2e2f6481a),SecurityGroupRule(8404294b-f34b-48bd-87fb-e14a1ff02647),SecurityGroupRule(a19c003f-a0e1-4b6e-811b-a4d51c2776ff),SecurityGroupRule(e0fa7e8b-7df9-4c74-b13c-82becde84a83)],shared=False,stateful=True,updated_at=2022-10-16T01:01:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.046576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (fb0998b3-74cd-4627-a1e8-57c2074611aa), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.047385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:15Z,description=,direction='egress',ethertype='IPv4',id=576f33dc-45cd-47d1-bd7a-2ac2e2f6481a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07fd28660dad4acf93dc9785e33d2366',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb0998b3-74cd-4627-a1e8-57c2074611aa,updated_at=2022-10-16T01:01:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.048175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (576f33dc-45cd-47d1-bd7a-2ac2e2f6481a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.048816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:01:16.049783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:15Z,description=,direction='ingress',ethertype='IPv6',id=8404294b-f34b-48bd-87fb-e14a1ff02647,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07fd28660dad4acf93dc9785e33d2366',protocol=,remote_address_group_id=,remote_group_id=fb0998b3-74cd-4627-a1e8-57c2074611aa,remote_ip_prefix=,revision_number=0,security_group_id=fb0998b3-74cd-4627-a1e8-57c2074611aa,updated_at=2022-10-16T01:01:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.050155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8404294b-f34b-48bd-87fb-e14a1ff02647), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.050536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:01:16.051399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:15Z,description=,direction='egress',ethertype='IPv6',id=a19c003f-a0e1-4b6e-811b-a4d51c2776ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07fd28660dad4acf93dc9785e33d2366',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb0998b3-74cd-4627-a1e8-57c2074611aa,updated_at=2022-10-16T01:01:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.052044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a19c003f-a0e1-4b6e-811b-a4d51c2776ff), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.054682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:01:16.058456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:15Z,description=,direction='ingress',ethertype='IPv4',id=e0fa7e8b-7df9-4c74-b13c-82becde84a83,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07fd28660dad4acf93dc9785e33d2366',protocol=,remote_address_group_id=,remote_group_id=fb0998b3-74cd-4627-a1e8-57c2074611aa,remote_ip_prefix=,revision_number=0,security_group_id=fb0998b3-74cd-4627-a1e8-57c2074611aa,updated_at=2022-10-16T01:01:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.059106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e0fa7e8b-7df9-4c74-b13c-82becde84a83), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.059448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:01:16.114917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 35e81c79-fcfc-45cc-82e6-d74a12d99947 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:16.115591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (35e81c79-fcfc-45cc-82e6-d74a12d99947), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.285944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T01:01:15Z,description='',dns_domain=None,id=ca7ce9c8-87fe-4660-9181-036527e2bb59,mtu=1500,name='tempest-TestMinimumBasicScenario-935068130-network',project_id='07fd28660dad4acf93dc9785e33d2366',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ca7ce9c8-87fe-4660-9181-036527e2bb59),segments=[NetworkSegment(49154b45-c807-4211-bfdc-183112535c72)],shared=False,status='ACTIVE',updated_at=2022-10-16T01:01:16Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.286652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (ca7ce9c8-87fe-4660-9181-036527e2bb59), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-9e48e83d-2739-4d14-a86c-ad24248827c6 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ca7ce9c8-87fe-4660-9181-036527e2bb59 with segmentation id not found. Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 01:01:16.361945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 01:01:16.362885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 01:01:16.362885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 01:01:16.362885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 01:01:16.362885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ca7ce9c8-87fe-4660-9181-036527e2bb59 with segmentation id not found. Oct 16 01:01:16.362885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 01:01:16.621757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-74c91cb8-e5db-48a2-9b74-6b09aaab1481 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(7870f779-c069-4c2f-b32d-fdac8b524faf)],cidr=172.20.0.0/28,created_at=2022-10-16T01:01:16Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=eb1d1d52-49a0-420b-bb3c-58555bc61df7,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-935068130-subnet',network_id=ca7ce9c8-87fe-4660-9181-036527e2bb59,project_id='07fd28660dad4acf93dc9785e33d2366',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T01:01:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:16.622270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-74c91cb8-e5db-48a2-9b74-6b09aaab1481 admin admin] Publish callbacks [] for Subnet (eb1d1d52-49a0-420b-bb3c-58555bc61df7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:16.864296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-63463769-6150-4792-b1dc-5556e28bfb35 None None] Resource Port 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=7d0732f2-b77d-4ee1-a9e9-7bf8e7736171,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7d0732f2-b77d-4ee1-a9e9-7bf8e7736171,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:16.865453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-63463769-6150-4792-b1dc-5556e28bfb35 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (7d0732f2-b77d-4ee1-a9e9-7bf8e7736171), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:17.201910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-63463769-6150-4792-b1dc-5556e28bfb35 None None] Resource Port 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7d0732f2-b77d-4ee1-a9e9-7bf8e7736171,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7d0732f2-b77d-4ee1-a9e9-7bf8e7736171,segment=NetworkSegment(74a0e3b5-1b19-4bfa-b460-92448029b4bb),segment_id=74a0e3b5-1b19-4bfa-b460-92448029b4bb)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7d0732f2-b77d-4ee1-a9e9-7bf8e7736171,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:17.202673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-63463769-6150-4792-b1dc-5556e28bfb35 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (7d0732f2-b77d-4ee1-a9e9-7bf8e7736171), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:17.221187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:355 started Oct 16 01:01:17.227126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=868000000,duration_sec=743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:17.228590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:17.229272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:355 - starting polling. Elapsed:0.008 Oct 16 01:01:17.233456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:17.239844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:355 - port information retrieved. Elapsed:0.019 Oct 16 01:01:17.241176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'9c8df3fc-5ba4-4d5b-a201-b5269c461008'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:17.243154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'mac_address': 'fa:16:3e:2f:57:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.143'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:17.251320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 9c8df3fc-5ba4-4d5b-a201-b5269c461008 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:17.252115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 9c8df3fc-5ba4-4d5b-a201-b5269c461008 updated. Details: {'device': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': '9c8df3fc-5ba4-4d5b-a201-b5269c461008', 'mac_address': 'fa:16:3e:2f:57:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.143'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:01:17.257238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9c8df3fc-5b, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:17.258740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-9c8df3fc-5b, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:17.259365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-9c8df3fc-5b, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:17.260166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:17.269599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e7c999f-22cf-4656-a6d4-2dcbdc987653 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:16Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca7ce9c8-87fe-4660-9181-036527e2bb59',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=73b1010c-4f64-4e77-9033-9c0c75eb24b8,mac_address=fa:16:3e:dd:3e:77,name='',network_id=ca7ce9c8-87fe-4660-9181-036527e2bb59,numa_affinity_policy=,project_id='07fd28660dad4acf93dc9785e33d2366',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(73b1010c-4f64-4e77-9033-9c0c75eb24b8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:17.272293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e7c999f-22cf-4656-a6d4-2dcbdc987653 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (73b1010c-4f64-4e77-9033-9c0c75eb24b8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:17.273983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-9c8df3fc-5b, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:17.275914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:17.282282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e5e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:17.283048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:355 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 27 devices currently available. Time elapsed: 0.041 Oct 16 01:01:17.283635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:01:17.284590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:01:17.285988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:17.286376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:17.294402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:17.356166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ac0645-aafa-408f-82fc-f9e9f8fcbdc7]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:17.357179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:355 - agent port security group processed in 0.115 Oct 16 01:01:17.358287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 9c8df3fc-5ba4-4d5b-a201-b5269c461008 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:17.558926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bcbfe645-25e2-4a6d-843f-91b050552e89","insert","qr-7d0732f2-b7",["set",[]],["map",[["attached-mac","fa:16:3e:05:1c:6f"],["iface-id","7d0732f2-b77d-4ee1-a9e9-7bf8e7736171"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:17.584991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bcbfe645-25e2-4a6d-843f-91b050552e89","old",null,["set",[]],null],["","new","qr-7d0732f2-b7",32,["map",[["attached-mac","fa:16:3e:05:1c:6f"],["iface-id","7d0732f2-b77d-4ee1-a9e9-7bf8e7736171"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:17.689224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-94f9d7d8-1488-4b69-894d-025217098f01 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:17Z,data_plane_status=None,description='',device_id='8af2423c-cd25-4ebc-b51f-b8d64d04b2bd',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,mac_address=fa:16:3e:73:82:9d,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:17Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:17.689795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-94f9d7d8-1488-4b69-894d-025217098f01 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:17.779902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['9c8df3fc-5ba4-4d5b-a201-b5269c461008'] and devices down [] completed. Oct 16 01:01:17.780225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:355 - ports processed. Elapsed:0.559 Oct 16 01:01:17.780569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.560 Oct 16 01:01:17.808352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e7c999f-22cf-4656-a6d4-2dcbdc987653 None None] Resource Port 73b1010c-4f64-4e77-9033-9c0c75eb24b8 updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=73b1010c-4f64-4e77-9033-9c0c75eb24b8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=73b1010c-4f64-4e77-9033-9c0c75eb24b8,segment=NetworkSegment(49154b45-c807-4211-bfdc-183112535c72),segment_id=49154b45-c807-4211-bfdc-183112535c72)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=73b1010c-4f64-4e77-9033-9c0c75eb24b8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:17.809506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e7c999f-22cf-4656-a6d4-2dcbdc987653 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (73b1010c-4f64-4e77-9033-9c0c75eb24b8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:17.872538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ee69c24-1a70-4008-ae49-b6e54ca571c6","insert","tap73b1010c-4f",["set",[]],["map",[["attached-mac","fa:16:3e:dd:3e:77"],["iface-id","73b1010c-4f64-4e77-9033-9c0c75eb24b8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:17.908767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ee69c24-1a70-4008-ae49-b6e54ca571c6","old",null,["set",[]],null],["","new","tap73b1010c-4f",33,["map",[["attached-mac","fa:16:3e:dd:3e:77"],["iface-id","73b1010c-4f64-4e77-9033-9c0c75eb24b8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:18.204239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 35e81c79-fcfc-45cc-82e6-d74a12d99947 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:18.204871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (35e81c79-fcfc-45cc-82e6-d74a12d99947), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:19.221756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:356 started Oct 16 01:01:19.224859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=867000000,duration_sec=745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:19.225433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:19.226529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:356 - starting polling. Elapsed:0.005 Oct 16 01:01:19.230456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:19.235547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:356 - port information retrieved. Elapsed:0.014 Oct 16 01:01:19.235892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'}, 'removed': set(), 'updated': {'73b1010c-4f64-4e77-9033-9c0c75eb24b8'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:19.236459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'mac_address': 'fa:16:3e:05:1c:6f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:19.236928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'mac_address': 'fa:16:3e:dd:3e:77', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:19.242723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:19.243088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 updated. Details: {'device': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'mac_address': 'fa:16:3e:05:1c:6f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 16 01:01:19.244328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7d0732f2-b7, col_values=(('tag', 12),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.245092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7d0732f2-b7, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.245672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7d0732f2-b7, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.260121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7d0732f2-b7, col_values=(('other_config', {'net_uuid': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '390'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.276745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e62,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:19.277374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 73b1010c-4f64-4e77-9033-9c0c75eb24b8 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:19.277728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 73b1010c-4f64-4e77-9033-9c0c75eb24b8 updated. Details: {'device': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'mac_address': 'fa:16:3e:dd:3e:77', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 01:01:19.278066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 13 as local vlan for net-id=ca7ce9c8-87fe-4660-9181-036527e2bb59, seg-id=389 Oct 16 01:01:19.282110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c97,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4485), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:19.284406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416e64,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4485}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:19.285305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap73b1010c-4f, col_values=(('tag', 13),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.285905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap73b1010c-4f, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.286511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap73b1010c-4f, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.297967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap73b1010c-4f, col_values=(('other_config', {'net_uuid': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '389'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:19.311627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e66,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:19.312288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:356 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 29 devices currently available. Time elapsed: 0.076 Oct 16 01:01:19.312646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 2 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:01:19.313133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'} Oct 16 01:01:19.314910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:19.315205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:19.322406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:19.386561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[8967135d-9388-4d5b-8107-8d87d28078aa]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:19.391470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:356 - agent port security group processed in 0.151 Oct 16 01:01:19.392690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:19.393215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 73b1010c-4f64-4e77-9033-9c0c75eb24b8 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:19.716978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2d1afccc-34c9-432a-9cc4-0ff2f808d64c None None] Resource Port 73b1010c-4f64-4e77-9033-9c0c75eb24b8 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:19.718630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2d1afccc-34c9-432a-9cc4-0ff2f808d64c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (73b1010c-4f64-4e77-9033-9c0c75eb24b8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:20.155085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c8034a05-41f0-459e-9e20-e952eb510b41 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:19Z,data_plane_status=None,description='',device_id='8af2423c-cd25-4ebc-b51f-b8d64d04b2bd',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5a7f9645-4a05-4db1-b67e-c1272d395572,mac_address=fa:16:3e:b4:5d:95,name='',network_id=ca7ce9c8-87fe-4660-9181-036527e2bb59,numa_affinity_policy=,project_id='07fd28660dad4acf93dc9785e33d2366',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5a7f9645-4a05-4db1-b67e-c1272d395572),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:19Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:20.155664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c8034a05-41f0-459e-9e20-e952eb510b41 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (5a7f9645-4a05-4db1-b67e-c1272d395572), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:20.228827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:20.230587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (7d0732f2-b77d-4ee1-a9e9-7bf8e7736171), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:20.385785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'] and devices down [] completed. Oct 16 01:01:20.386291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:356 - ports processed. Elapsed:1.165 Oct 16 01:01:20.386593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:1.165 Oct 16 01:01:20.536765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1e0eea20-8dea-43a8-a464-696510d867e3 None None] Resource Port d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:20.537144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1e0eea20-8dea-43a8-a464-696510d867e3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:20.648078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c8034a05-41f0-459e-9e20-e952eb510b41 admin admin] Received resource Port update without any changes: 5a7f9645-4a05-4db1-b67e-c1272d395572 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 01:01:20.726165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1e0eea20-8dea-43a8-a464-696510d867e3 None None] Resource Port d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:20.726678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1e0eea20-8dea-43a8-a464-696510d867e3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:21.222466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:357 started Oct 16 01:01:21.227107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=869000000,duration_sec=747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:21.227913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:21.228417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:357 - starting polling. Elapsed:0.006 Oct 16 01:01:21.232201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:21.238442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:357 - port information retrieved. Elapsed:0.016 Oct 16 01:01:21.239010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:21.239764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'mac_address': 'fa:16:3e:05:1c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:21.240509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'mac_address': 'fa:16:3e:dd:3e:77', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:21.246818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:21.247438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 updated. Details: {'device': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'device_id': '72e98af7-ae6e-4be9-83da-b23277f8f803', 'network_id': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'port_id': '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', 'mac_address': 'fa:16:3e:05:1c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '9efd72bb-10d0-4ec3-88df-b489c0a0e472', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Oct 16 01:01:21.248536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7d0732f2-b7, col_values=(('tag', 12),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.249354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7d0732f2-b7, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.249354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7d0732f2-b7, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.249801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:21.251136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7d0732f2-b7, col_values=(('other_config', {'net_uuid': '3e12ae87-77ee-4d05-8dce-be1b6f55d51c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '390', 'tag': '12'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.252005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:21.255465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e6a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:21.256000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 73b1010c-4f64-4e77-9033-9c0c75eb24b8 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:21.256641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 73b1010c-4f64-4e77-9033-9c0c75eb24b8 updated. Details: {'device': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'mac_address': 'fa:16:3e:dd:3e:77', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 16 01:01:21.258423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap73b1010c-4f, col_values=(('tag', 13),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.259736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap73b1010c-4f, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.260294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap73b1010c-4f, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.260904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:21.261689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap73b1010c-4f, col_values=(('other_config', {'net_uuid': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '389', 'tag': '13'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:21.262373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:21.265656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e6c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:21.266015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:357 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 29 devices currently available. Time elapsed: 0.026 Oct 16 01:01:21.266425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 2 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:01:21.266898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:01:21.268754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:21.269051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:21.280575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:21.343961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[be015967-4c46-4f6e-bd22-c0bad612bf21]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:21.344661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:357 - agent port security group processed in 0.105 Oct 16 01:01:21.345712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:21.346090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 73b1010c-4f64-4e77-9033-9c0c75eb24b8 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:21.517342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9c42353d-9a61-44d8-92ce-328e00d2ba39","insert","qr-5a7f9645-4a",["set",[]],["map",[["attached-mac","fa:16:3e:b4:5d:95"],["iface-id","5a7f9645-4a05-4db1-b67e-c1272d395572"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:21.546519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9c42353d-9a61-44d8-92ce-328e00d2ba39","old",null,["set",[]],null],["","new","qr-5a7f9645-4a",34,["map",[["attached-mac","fa:16:3e:b4:5d:95"],["iface-id","5a7f9645-4a05-4db1-b67e-c1272d395572"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:21.713016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'] and devices down [] completed. Oct 16 01:01:21.713581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:357 - ports processed. Elapsed:0.491 Oct 16 01:01:21.714118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.492 Oct 16 01:01:22.092886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f7073b4a-fcc2-46e8-92cb-e9303a35b65f","insert","qg-d85e9b46-c5",["set",[]],["map",[["attached-mac","fa:16:3e:73:82:9d"],["iface-id","d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:22.126936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f7073b4a-fcc2-46e8-92cb-e9303a35b65f","old",null,["set",[]],null],["","new","qg-d85e9b46-c5",35,["map",[["attached-mac","fa:16:3e:73:82:9d"],["iface-id","d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:01:23.223179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:358 started Oct 16 01:01:23.226429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=869000000,duration_sec=749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:23.227043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:23.227717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:358 - starting polling. Elapsed:0.005 Oct 16 01:01:23.231514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:23.236674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:358 - port information retrieved. Elapsed:0.014 Oct 16 01:01:23.237022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': {'d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', '5a7f9645-4a05-4db1-b67e-c1272d395572'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:23.237649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'mac_address': 'fa:16:3e:73:82:9d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.90'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:23.238260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:19Z,data_plane_status=None,description='',device_id='8af2423c-cd25-4ebc-b51f-b8d64d04b2bd',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5a7f9645-4a05-4db1-b67e-c1272d395572,mac_address=fa:16:3e:b4:5d:95,name='',network_id=ca7ce9c8-87fe-4660-9181-036527e2bb59,numa_affinity_policy=,project_id='07fd28660dad4acf93dc9785e33d2366',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(5a7f9645-4a05-4db1-b67e-c1272d395572),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:01:20Z) is not bound. Oct 16 01:01:23.254661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:23.255035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 updated. Details: {'device': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'mac_address': 'fa:16:3e:73:82:9d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.90'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:01:23.256062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d85e9b46-c5, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:23.256488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d85e9b46-c5, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:23.256994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d85e9b46-c5, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:23.275898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d85e9b46-c5, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:23.293623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e70,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:23.293975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 5a7f9645-4a05-4db1-b67e-c1272d395572 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:23.297512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Device 5a7f9645-4a05-4db1-b67e-c1272d395572 not defined on plugin or binding failed Oct 16 01:01:23.298204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:358 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.061 Oct 16 01:01:23.298572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 2 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:01:23.298911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', '5a7f9645-4a05-4db1-b67e-c1272d395572'} Oct 16 01:01:23.305052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:23.305291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:23.317287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:23.379146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83c9c8-9205-4c9c-969d-f2ed97824521]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:23.380046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:358 - agent port security group processed in 0.143 Oct 16 01:01:23.381130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:23.563004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1'] and devices down [] completed. Oct 16 01:01:23.563329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:358 - ports processed. Elapsed:0.340 Oct 16 01:01:23.563666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.341 Oct 16 01:01:23.663632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:23.664512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:25.224507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:359 started Oct 16 01:01:25.227294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=870000000,duration_sec=751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:25.228468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:25.228667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:359 - starting polling. Elapsed:0.004 Oct 16 01:01:25.233063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:25.239834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:359 - port information retrieved. Elapsed:0.016 Oct 16 01:01:25.240299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:25.241083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'mac_address': 'fa:16:3e:73:82:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.90'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:25.246661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:25.247133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 updated. Details: {'device': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'mac_address': 'fa:16:3e:73:82:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.90'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:01:25.248259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d85e9b46-c5, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:25.248762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d85e9b46-c5, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:25.249244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d85e9b46-c5, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:25.250063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:25.250621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d85e9b46-c5, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:25.251521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:25.256291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e74,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:25.257489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:359 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.016 Oct 16 01:01:25.257489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:01:25.258141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:01:25.260917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:25.261276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:25.267414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:25.310807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[470820c9-5aa6-4043-9ea1-779bfb93bcdd]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:25.311557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:359 - agent port security group processed in 0.071 Oct 16 01:01:25.312605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:25.479956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1'] and devices down [] completed. Oct 16 01:01:25.480286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:359 - ports processed. Elapsed:0.256 Oct 16 01:01:25.480632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.256 Oct 16 01:01:26.798199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a4fbeba2-b1d9-42b4-9b4b-1c9443b84003 None None] Resource Port 5a7f9645-4a05-4db1-b67e-c1272d395572 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=5a7f9645-4a05-4db1-b67e-c1272d395572,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5a7f9645-4a05-4db1-b67e-c1272d395572,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:26.799428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a4fbeba2-b1d9-42b4-9b4b-1c9443b84003 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (5a7f9645-4a05-4db1-b67e-c1272d395572), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:27.076766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a4fbeba2-b1d9-42b4-9b4b-1c9443b84003 None None] Resource Port 5a7f9645-4a05-4db1-b67e-c1272d395572 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5a7f9645-4a05-4db1-b67e-c1272d395572,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5a7f9645-4a05-4db1-b67e-c1272d395572,segment=NetworkSegment(49154b45-c807-4211-bfdc-183112535c72),segment_id=49154b45-c807-4211-bfdc-183112535c72)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5a7f9645-4a05-4db1-b67e-c1272d395572,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:27.077445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a4fbeba2-b1d9-42b4-9b4b-1c9443b84003 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (5a7f9645-4a05-4db1-b67e-c1272d395572), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:27.225466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:360 started Oct 16 01:01:27.229282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e76,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=872000000,duration_sec=753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:27.230432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:27.231145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:360 - starting polling. Elapsed:0.006 Oct 16 01:01:27.234903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:27.245557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:360 - port information retrieved. Elapsed:0.020 Oct 16 01:01:27.248107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'5a7f9645-4a05-4db1-b67e-c1272d395572'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:27.249643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'mac_address': 'fa:16:3e:b4:5d:95', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:27.255842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 5a7f9645-4a05-4db1-b67e-c1272d395572 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:27.258648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 5a7f9645-4a05-4db1-b67e-c1272d395572 updated. Details: {'device': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'mac_address': 'fa:16:3e:b4:5d:95', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 16 01:01:27.260428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5a7f9645-4a, col_values=(('tag', 13),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:27.261223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-5a7f9645-4a, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:27.262376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-5a7f9645-4a, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:27.270699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5a7f9645-4a, col_values=(('other_config', {'net_uuid': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '389'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:27.289828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e78,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:27.290511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:360 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.042 Oct 16 01:01:27.291267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:01:27.291937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:01:27.293526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:27.294048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:27.300494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:27.366215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b237411-1abb-48a1-bde5-65d75e6c4a7f]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:27.367037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:360 - agent port security group processed in 0.118 Oct 16 01:01:27.368077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 5a7f9645-4a05-4db1-b67e-c1272d395572 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:27.594215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['5a7f9645-4a05-4db1-b67e-c1272d395572'] and devices down [] completed. Oct 16 01:01:27.594772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:360 - ports processed. Elapsed:0.370 Oct 16 01:01:27.595139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.370 Oct 16 01:01:27.653510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port 5a7f9645-4a05-4db1-b67e-c1272d395572 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:27.654242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (5a7f9645-4a05-4db1-b67e-c1272d395572), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:29.227546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:361 started Oct 16 01:01:29.233952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e7a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=874000000,duration_sec=755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:29.234567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:29.234928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:361 - starting polling. Elapsed:0.008 Oct 16 01:01:29.238702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:29.244188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:361 - port information retrieved. Elapsed:0.017 Oct 16 01:01:29.244542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '29057d15-832d-4bc1-939a-b77306acef22', '54484db5-9b23-44a4-aeef-b1d117e40429', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '42633501-06b6-4c52-92d4-45822c5b414e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': set(), 'updated': {'5a7f9645-4a05-4db1-b67e-c1272d395572'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:01:29.245113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'mac_address': 'fa:16:3e:b4:5d:95', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:01:29.252449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 5a7f9645-4a05-4db1-b67e-c1272d395572 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:01:29.253016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 5a7f9645-4a05-4db1-b67e-c1272d395572 updated. Details: {'device': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'device_id': '8af2423c-cd25-4ebc-b51f-b8d64d04b2bd', 'network_id': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'port_id': '5a7f9645-4a05-4db1-b67e-c1272d395572', 'mac_address': 'fa:16:3e:b4:5d:95', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'eb1d1d52-49a0-420b-bb3c-58555bc61df7', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Oct 16 01:01:29.254288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5a7f9645-4a, col_values=(('tag', 13),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:29.254879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-5a7f9645-4a, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:29.255437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-5a7f9645-4a, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:29.256036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:29.256832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5a7f9645-4a, col_values=(('other_config', {'net_uuid': 'ca7ce9c8-87fe-4660-9181-036527e2bb59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '389', 'tag': '13'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:01:29.257506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:01:29.259964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416e7c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:29.260661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:361 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.016 Oct 16 01:01:29.261191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:01:29.261643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:01:29.263393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:01:29.263766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:01:29.274190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:01:29.337486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a03cd-97fa-4269-9282-f9fc8d37b749]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:01:29.338352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:361 - agent port security group processed in 0.093 Oct 16 01:01:29.339520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 5a7f9645-4a05-4db1-b67e-c1272d395572 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:01:29.503061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['5a7f9645-4a05-4db1-b67e-c1272d395572'] and devices down [] completed. Oct 16 01:01:29.503675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:361 - ports processed. Elapsed:0.277 Oct 16 01:01:29.504195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.277 Oct 16 01:01:31.228448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:362 started Oct 16 01:01:31.231470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e7e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=874000000,duration_sec=757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:31.232257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:31.232914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:01:33.229942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:363 started Oct 16 01:01:33.233088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e80,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=876000000,duration_sec=759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:33.234069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:33.234069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:01:34.009074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1fc733ed-3309-4d90-bf35-e26154cf848f tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:33Z,data_plane_status=None,description='',device_id='aa091bd0-0127-4e6a-8b16-a7956cc5379e',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c570709d-29cc-4c4f-a39b-9bfd4da608ed,mac_address=fa:16:3e:0a:02:01,name='',network_id=3e12ae87-77ee-4d05-8dce-be1b6f55d51c,numa_affinity_policy=,project_id='343c019304314c669a3381cc4c68e481',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c570709d-29cc-4c4f-a39b-9bfd4da608ed),security_group_ids=set([55d9e52b-b53a-433b-b3a4-a72e6e3f2b56]),status='DOWN',updated_at=2022-10-16T01:01:33Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:34.009718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1fc733ed-3309-4d90-bf35-e26154cf848f tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:34.010404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1fc733ed-3309-4d90-bf35-e26154cf848f tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group member updated {'55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'} Oct 16 01:01:35.231028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:364 started Oct 16 01:01:35.233626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=876000000,duration_sec=761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:35.234204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:35.234579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:364 - starting polling. Elapsed:0.004 Oct 16 01:01:35.238525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:35.244177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:364 - port information retrieved. Elapsed:0.014 Oct 16 01:01:35.244525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:01:37.231601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:365 started Oct 16 01:01:37.234374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=877000000,duration_sec=763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:37.235018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:37.235377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:01:39.233119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:366 started Oct 16 01:01:39.235840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=879000000,duration_sec=765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:39.236409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:39.236763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:01:41.234046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:367 started Oct 16 01:01:41.239481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=881000000,duration_sec=767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:41.240763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:41.241646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 01:01:43.236198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:368 started Oct 16 01:01:43.240643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=883000000,duration_sec=769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:43.241242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:43.241605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 01:01:44.743570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-081f7ccc-10fc-473a-804c-e644d3742108 service neutron] Resource Port c570709d-29cc-4c4f-a39b-9bfd4da608ed updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=c570709d-29cc-4c4f-a39b-9bfd4da608ed,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=c570709d-29cc-4c4f-a39b-9bfd4da608ed,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:44.744312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-081f7ccc-10fc-473a-804c-e644d3742108 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:45.006436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-081f7ccc-10fc-473a-804c-e644d3742108 service neutron] Resource Port c570709d-29cc-4c4f-a39b-9bfd4da608ed updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=c570709d-29cc-4c4f-a39b-9bfd4da608ed,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c570709d-29cc-4c4f-a39b-9bfd4da608ed,segment=NetworkSegment(74a0e3b5-1b19-4bfa-b460-92448029b4bb),segment_id=74a0e3b5-1b19-4bfa-b460-92448029b4bb)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=c570709d-29cc-4c4f-a39b-9bfd4da608ed,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:45.007656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-081f7ccc-10fc-473a-804c-e644d3742108 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:45.237419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:369 started Oct 16 01:01:45.240152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=883000000,duration_sec=771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:45.240826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:45.241714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:369 - starting polling. Elapsed:0.004 Oct 16 01:01:45.245677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:45.250957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:369 - port information retrieved. Elapsed:0.014 Oct 16 01:01:45.251290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:01:47.238102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:370 started Oct 16 01:01:47.240533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=884000000,duration_sec=773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:47.241698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:47.242040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:01:49.239388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:371 started Oct 16 01:01:49.242426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=885000000,duration_sec=775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:49.243039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:49.243402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:01:50.348784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f197bc68-0135-4f5c-8583-168f55cbe77e tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource Port deleted: 9f15f027-a9c6-4298-a989-336905ee5a12 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:50.349443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f197bc68-0135-4f5c-8583-168f55cbe77e tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (9f15f027-a9c6-4298-a989-336905ee5a12), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:50.357880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f197bc68-0135-4f5c-8583-168f55cbe77e tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group member updated {'d93458da-7a02-4d80-8695-660bb21543cd'} Oct 16 01:01:51.241536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:372 started Oct 16 01:01:51.245538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=887000000,duration_sec=777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:51.247752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:51.248207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:372 - starting polling. Elapsed:0.008 Oct 16 01:01:51.256554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:51.259286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 9f15f027-a9c6-4298-a989-336905ee5a12 not present in bridge br-int Oct 16 01:01:51.259636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:01:51.259932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['9f15f027-a9c6-4298-a989-336905ee5a12'] Oct 16 01:01:51.260263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 9f15f027-a9c6-4298-a989-336905ee5a12 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:01:51.265242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:372 - port information retrieved. Elapsed:0.025 Oct 16 01:01:51.265583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.026 Oct 16 01:01:52.115077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port c570709d-29cc-4c4f-a39b-9bfd4da608ed updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:52.116276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:52.776514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroup deleted: d93458da-7a02-4d80-8695-660bb21543cd {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:52.776985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (d93458da-7a02-4d80-8695-660bb21543cd), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:52.777503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d93458da-7a02-4d80-8695-660bb21543cd',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:01:52.792170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d93458da-7a02-4d80-8695-660bb21543cd',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:01:52.792715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: 4d5e18df-9c97-47e0-a54b-c66c5a50bb4f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:52.793083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4d5e18df-9c97-47e0-a54b-c66c5a50bb4f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:52.793411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 01:01:52.793797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: be9a3d44-b7f9-4204-a809-bc052b15a2f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:52.794139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (be9a3d44-b7f9-4204-a809-bc052b15a2f1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:52.794454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 01:01:52.794820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: af5d9393-0fea-488a-9fba-d1ded2a6c25b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:52.795192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (af5d9393-0fea-488a-9fba-d1ded2a6c25b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:52.795505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 01:01:52.795868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: 68911359-5b95-49c8-bbf7-8be4f388653a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:52.796204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (68911359-5b95-49c8-bbf7-8be4f388653a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:52.796518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-deb9677f-1575-4fc9-ae84-a4bde990eead tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['d93458da-7a02-4d80-8695-660bb21543cd'] Oct 16 01:01:53.241518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:373 started Oct 16 01:01:53.244290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=887000000,duration_sec=779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:53.244920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:53.245358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:373 - starting polling. Elapsed:0.004 Oct 16 01:01:53.248997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.254326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:373 - port information retrieved. Elapsed:0.013 Oct 16 01:01:53.254665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:01:53.284054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-73f0ac1b-16f6-4b8e-ab89-765c03a1b786 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource Port deleted: 5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:01:53.284542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-73f0ac1b-16f6-4b8e-ab89-765c03a1b786 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.558064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:01:53Z,description='tempest-description--947491815',id=7a302bbe-1b5a-4b2e-b9f1-c83b17171a75,is_default=False,name='tempest-securitygroup--1814361043',project_id='cca355ef4a294ecd88cc299b7e0ca9d8',revision_number=1,rules=[SecurityGroupRule(7acf5b9d-cb30-40be-ace3-b109df7f4493),SecurityGroupRule(b764117e-e126-439e-8de6-9c297253f3fe)],shared=False,stateful=True,updated_at=2022-10-16T01:01:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:53.558539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (7a302bbe-1b5a-4b2e-b9f1-c83b17171a75), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.559146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:53Z,description=,direction='egress',ethertype='IPv4',id=7acf5b9d-cb30-40be-ace3-b109df7f4493,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a302bbe-1b5a-4b2e-b9f1-c83b17171a75,updated_at=2022-10-16T01:01:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:53.559513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7acf5b9d-cb30-40be-ace3-b109df7f4493), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.559855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:01:53.560568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:53Z,description=,direction='egress',ethertype='IPv6',id=b764117e-e126-439e-8de6-9c297253f3fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a302bbe-1b5a-4b2e-b9f1-c83b17171a75,updated_at=2022-10-16T01:01:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:53.561061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b764117e-e126-439e-8de6-9c297253f3fe), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.561406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d4829585-b1a8-4d8e-b810-95a9d460c549 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:01:53.675694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7e2ccbe3-a543-4468-9a77-c2c9058a9cad tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:53Z,description='',direction='ingress',ethertype='IPv4',id=b8830810-32d4-4b25-a1a0-7c0904b05a25,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a302bbe-1b5a-4b2e-b9f1-c83b17171a75,updated_at=2022-10-16T01:01:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:53.676041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7e2ccbe3-a543-4468-9a77-c2c9058a9cad tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b8830810-32d4-4b25-a1a0-7c0904b05a25), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.676396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7e2ccbe3-a543-4468-9a77-c2c9058a9cad tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:01:53.798658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8139049b-b93a-4e25-86a4-179bd0c19a2f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:01:53Z,description='',direction='ingress',ethertype='IPv4',id=8c5ee50f-5bda-41e4-82a7-41902f13e883,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a302bbe-1b5a-4b2e-b9f1-c83b17171a75,updated_at=2022-10-16T01:01:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:53.799183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8139049b-b93a-4e25-86a4-179bd0c19a2f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8c5ee50f-5bda-41e4-82a7-41902f13e883), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:53.800106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8139049b-b93a-4e25-86a4-179bd0c19a2f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:01:54.099470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port c570709d-29cc-4c4f-a39b-9bfd4da608ed updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:54.100016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:54.320294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-763856d2-f598-4796-b730-a8ec4d5278fd tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:53Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7cec60c5-5837-4d17-acde-a907096deefb,mac_address=fa:16:3e:7c:20:b9,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7cec60c5-5837-4d17-acde-a907096deefb),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:01:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:54.320891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-763856d2-f598-4796-b730-a8ec4d5278fd tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (7cec60c5-5837-4d17-acde-a907096deefb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:54.754341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-763856d2-f598-4796-b730-a8ec4d5278fd tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource Port 7cec60c5-5837-4d17-acde-a907096deefb updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '81adbe54-8585-4a3c-a34c-480f532f82d3'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:54.754732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-763856d2-f598-4796-b730-a8ec4d5278fd tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (7cec60c5-5837-4d17-acde-a907096deefb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:55.242653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:374 started Oct 16 01:01:55.245166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=888000000,duration_sec=781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:55.245779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:55.246123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:374 - starting polling. Elapsed:0.004 Oct 16 01:01:55.249782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:55.252281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0 not present in bridge br-int Oct 16 01:01:55.252630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:01:55.252926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0'] Oct 16 01:01:55.253258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 5a99b075-cbe5-454a-8bc1-1fa3cc1d4ca0 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:01:55.258416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:374 - port information retrieved. Elapsed:0.016 Oct 16 01:01:55.258763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 16 01:01:57.244090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:375 started Oct 16 01:01:57.246890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=890000000,duration_sec=783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:57.247586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:57.248038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:01:58.891487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dc378552-fba0-481c-80b8-93f8fcacebd4 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:01:58Z,data_plane_status=None,description='',device_id='0f07f47f-8851-4e67-9c77-d4115ff157c7',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=544a970e-fd66-4b0a-ba39-0dcfeed391f8,mac_address=fa:16:3e:ca:bb:e4,name='',network_id=758abdbd-543f-42fe-8aa7-53af6cbbeb5d,numa_affinity_policy=,project_id='cca355ef4a294ecd88cc299b7e0ca9d8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(544a970e-fd66-4b0a-ba39-0dcfeed391f8),security_group_ids=set([7a302bbe-1b5a-4b2e-b9f1-c83b17171a75]),status='DOWN',updated_at=2022-10-16T01:01:58Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:01:58.892643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dc378552-fba0-481c-80b8-93f8fcacebd4 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:58.893475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dc378552-fba0-481c-80b8-93f8fcacebd4 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group member updated {'7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'} Oct 16 01:01:59.245062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:376 started Oct 16 01:01:59.248148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=891000000,duration_sec=785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:01:59.248807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:01:59.249222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:376 - starting polling. Elapsed:0.004 Oct 16 01:01:59.252955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:59.258811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:376 - port information retrieved. Elapsed:0.014 Oct 16 01:01:59.259246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:01:59.433859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8130ce33-666c-498b-a481-11fef2f8f0da service neutron] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=544a970e-fd66-4b0a-ba39-0dcfeed391f8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=544a970e-fd66-4b0a-ba39-0dcfeed391f8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:59.434250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8130ce33-666c-498b-a481-11fef2f8f0da service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:01:59.730891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8130ce33-666c-498b-a481-11fef2f8f0da service neutron] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=544a970e-fd66-4b0a-ba39-0dcfeed391f8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=544a970e-fd66-4b0a-ba39-0dcfeed391f8,segment=NetworkSegment(dcee8df3-2008-4b96-bcaf-2c5a70d931e0),segment_id=dcee8df3-2008-4b96-bcaf-2c5a70d931e0)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=544a970e-fd66-4b0a-ba39-0dcfeed391f8,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:01:59.731323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8130ce33-666c-498b-a481-11fef2f8f0da service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:01.246510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:377 started Oct 16 01:02:01.249486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=893000000,duration_sec=787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:01.250179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:01.250565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:377 - starting polling. Elapsed:0.004 Oct 16 01:02:01.254186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:01.259953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:377 - port information retrieved. Elapsed:0.014 Oct 16 01:02:01.260383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:02:02.122452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:02.122835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:03.248008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:378 started Oct 16 01:02:03.250847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416e9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=893000000,duration_sec=789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:03.251450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:03.251822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:378 - starting polling. Elapsed:0.004 Oct 16 01:02:03.255431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:03.260639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:378 - port information retrieved. Elapsed:0.013 Oct 16 01:02:03.260982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:02:04.093315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:04.093705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:05.249301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:379 started Oct 16 01:02:05.251695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ea0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=895000000,duration_sec=791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:05.252271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:05.252607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:379 - starting polling. Elapsed:0.004 Oct 16 01:02:05.256162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:05.262045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:379 - port information retrieved. Elapsed:0.013 Oct 16 01:02:05.262380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:02:07.250448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:380 started Oct 16 01:02:07.253788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ea2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=897000000,duration_sec=793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:07.254835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:07.255570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:02:07.377417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e4ff9ba-b3ed-4a8f-87d7-451a62450e29 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:02:07Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=87e7e566-7b39-4933-8e8c-8d7ac54f0dd7,mac_address=fa:16:3e:5a:22:35,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(87e7e566-7b39-4933-8e8c-8d7ac54f0dd7),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:02:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:07.378070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e4ff9ba-b3ed-4a8f-87d7-451a62450e29 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (87e7e566-7b39-4933-8e8c-8d7ac54f0dd7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:08.067515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9e4ff9ba-b3ed-4a8f-87d7-451a62450e29 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource Port 87e7e566-7b39-4933-8e8c-8d7ac54f0dd7 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '8727a437-04f1-4afb-b5dc-f0c4bbff0c8c'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:08.068031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9e4ff9ba-b3ed-4a8f-87d7-451a62450e29 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (87e7e566-7b39-4933-8e8c-8d7ac54f0dd7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.252171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:381 started Oct 16 01:02:09.257815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ea4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=900000000,duration_sec=795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:09.259031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:09.259481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:381 - starting polling. Elapsed:0.008 Oct 16 01:02:09.265278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.272903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:381 - port information retrieved. Elapsed:0.021 Oct 16 01:02:09.273258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Oct 16 01:02:09.335540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:02:09Z,description='tempest-secgroup-smoke-932958323 description',id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,is_default=False,name='tempest-secgroup-smoke-932958323',project_id='343c019304314c669a3381cc4c68e481',revision_number=1,rules=[SecurityGroupRule(1111aa19-d114-467a-a09c-191d14379bbb),SecurityGroupRule(a60db376-071c-489f-8598-fdef7f31b2f2)],shared=False,stateful=True,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.336537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (ef62311a-4a30-42aa-bd68-cc2deadeb13a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.337634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:09Z,description=,direction='egress',ethertype='IPv6',id=1111aa19-d114-467a-a09c-191d14379bbb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.338342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1111aa19-d114-467a-a09c-191d14379bbb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.338936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:09.339690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:09Z,description=,direction='egress',ethertype='IPv4',id=a60db376-071c-489f-8598-fdef7f31b2f2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.340085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a60db376-071c-489f-8598-fdef7f31b2f2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.340394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-daca8cf1-c90b-4d65-b028-3eb568f312c7 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:09.502307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fef0595e-605a-444d-9bc3-14ef76d39f34 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:09Z,description='',direction='ingress',ethertype='IPv4',id=6b76ae23-18e2-411e-ba1f-7be265209579,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='343c019304314c669a3381cc4c68e481',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.502801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fef0595e-605a-444d-9bc3-14ef76d39f34 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6b76ae23-18e2-411e-ba1f-7be265209579), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.503544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fef0595e-605a-444d-9bc3-14ef76d39f34 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:09.653154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1d6d78c4-be7d-4ea0-9dee-6e389d907ae8 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:09Z,description='',direction='egress',ethertype='IPv4',id=60853c63-505f-430b-93d3-fc2137987257,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='343c019304314c669a3381cc4c68e481',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.653154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1d6d78c4-be7d-4ea0-9dee-6e389d907ae8 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (60853c63-505f-430b-93d3-fc2137987257), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.653154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1d6d78c4-be7d-4ea0-9dee-6e389d907ae8 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:09.783518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-53111820-36a1-4b44-9cb5-30eb9623b4cb tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:09Z,description='',direction='ingress',ethertype='IPv4',id=baa16170-e29a-4541-aa20-fcfecf4ce86b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.784238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-53111820-36a1-4b44-9cb5-30eb9623b4cb tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (baa16170-e29a-4541-aa20-fcfecf4ce86b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.784934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-53111820-36a1-4b44-9cb5-30eb9623b4cb tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:09.962828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0ee8a62e-0565-4957-987e-5aa96a1a4901 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:09Z,description='',direction='egress',ethertype='IPv4',id=25dc17ef-227d-44c3-9b47-bfcdcc249ea6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:09.963356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0ee8a62e-0565-4957-987e-5aa96a1a4901 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (25dc17ef-227d-44c3-9b47-bfcdcc249ea6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:09.964193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0ee8a62e-0565-4957-987e-5aa96a1a4901 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:10.107142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2d1fcdd2-163f-49c3-a340-578ffc92fd95 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:10Z,description='',direction='ingress',ethertype='IPv6',id=30a67a71-f8fd-42ca-a402-6d3af81327f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:10.107538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2d1fcdd2-163f-49c3-a340-578ffc92fd95 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (30a67a71-f8fd-42ca-a402-6d3af81327f6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:10.107901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2d1fcdd2-163f-49c3-a340-578ffc92fd95 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:10.251302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e28d954f-4fcb-4073-9749-212140af29d6 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:10Z,description='',direction='egress',ethertype='IPv6',id=98475baf-fda3-428a-bec4-c23ab3faf91e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='343c019304314c669a3381cc4c68e481',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef62311a-4a30-42aa-bd68-cc2deadeb13a,updated_at=2022-10-16T01:02:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:10.251936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e28d954f-4fcb-4073-9749-212140af29d6 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (98475baf-fda3-428a-bec4-c23ab3faf91e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:10.252275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e28d954f-4fcb-4073-9749-212140af29d6 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:02:11.107062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c07c0b8-12ac-420c-8369-e9727f2d7223 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource Port c570709d-29cc-4c4f-a39b-9bfd4da608ed updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'})} New fields: {'security_group_ids': CoercedSet({'ef62311a-4a30-42aa-bd68-cc2deadeb13a', '55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'})} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:11.108220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c07c0b8-12ac-420c-8369-e9727f2d7223 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:11.108998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c07c0b8-12ac-420c-8369-e9727f2d7223 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group member updated {'ef62311a-4a30-42aa-bd68-cc2deadeb13a', '55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'} Oct 16 01:02:11.252808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:382 started Oct 16 01:02:11.256034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ea6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=899000000,duration_sec=797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:11.259031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:11.259753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:382 - starting polling. Elapsed:0.007 Oct 16 01:02:11.264259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:11.270053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:382 - port information retrieved. Elapsed:0.017 Oct 16 01:02:11.270547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 16 01:02:13.254550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:383 started Oct 16 01:02:13.257254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ea8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=900000000,duration_sec=799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:13.257853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:13.258209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:02:15.254298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:384 started Oct 16 01:02:15.256671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eaa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=900000000,duration_sec=801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:15.257243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:15.257598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:17.255027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:385 started Oct 16 01:02:17.257507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=900000000,duration_sec=803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:17.259204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:17.259574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:02:19.255719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:386 started Oct 16 01:02:19.258327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=901000000,duration_sec=805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:19.258960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:19.259325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:21.257180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:387 started Oct 16 01:02:21.260520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=903000000,duration_sec=807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:21.261385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:21.261811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:02:22.849385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-67c8a9cb-1488-442c-aa1c-a3b39cc60320 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: 35e81c79-fcfc-45cc-82e6-d74a12d99947 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:22.850028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-67c8a9cb-1488-442c-aa1c-a3b39cc60320 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (35e81c79-fcfc-45cc-82e6-d74a12d99947), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:22.850326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-67c8a9cb-1488-442c-aa1c-a3b39cc60320 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'f5484aef-779d-4d62-a0b7-8316aca70412'} Oct 16 01:02:23.258728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:388 started Oct 16 01:02:23.261421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=904000000,duration_sec=809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:23.262261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:23.262724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:388 - starting polling. Elapsed:0.004 Oct 16 01:02:23.267154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:23.270357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 35e81c79-fcfc-45cc-82e6-d74a12d99947 not present in bridge br-int Oct 16 01:02:23.270721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:02:23.271666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['35e81c79-fcfc-45cc-82e6-d74a12d99947'] Oct 16 01:02:23.272037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 35e81c79-fcfc-45cc-82e6-d74a12d99947 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:02:23.277973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:388 - port information retrieved. Elapsed:0.019 Oct 16 01:02:23.278557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Oct 16 01:02:25.026412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroup deleted: f5484aef-779d-4d62-a0b7-8316aca70412 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:25.027183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (f5484aef-779d-4d62-a0b7-8316aca70412), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.027502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f5484aef-779d-4d62-a0b7-8316aca70412',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:02:25.043974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f5484aef-779d-4d62-a0b7-8316aca70412',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:02:25.044567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 7562e087-c6d5-47b9-ac84-f2ec8db10ef5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:25.044964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7562e087-c6d5-47b9-ac84-f2ec8db10ef5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.045323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:02:25.045712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: c89ad12f-848d-4451-91bf-85cc3290561c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:25.046085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c89ad12f-848d-4451-91bf-85cc3290561c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.046802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:02:25.047218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: ea084f5d-a316-4761-acdf-1e4b3a31d6a1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:25.047591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ea084f5d-a316-4761-acdf-1e4b3a31d6a1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.047919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:02:25.048290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 2e8b8bc7-ca13-43a6-bdfd-ab7c1cd90b23 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:25.048635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2e8b8bc7-ca13-43a6-bdfd-ab7c1cd90b23), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.048983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-91b60701-4959-4277-919a-49f3738d9d61 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['f5484aef-779d-4d62-a0b7-8316aca70412'] Oct 16 01:02:25.260120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:389 started Oct 16 01:02:25.262559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=906000000,duration_sec=811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:25.263179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:25.263535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:25.416360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5f789a79-6d91-4d09-bda6-33a5f1b38693 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: 41018b25-ef72-4267-9902-28254b241fb5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:25.416797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5f789a79-6d91-4d09-bda6-33a5f1b38693 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (41018b25-ef72-4267-9902-28254b241fb5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.693172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:02:25Z,description='tempest-description--1690935413',id=47131bbf-f06f-4a48-870c-42726cd628dd,is_default=False,name='tempest-securitygroup--530173324',project_id='fb3c758e27684dcd9265e2d60036d80b',revision_number=1,rules=[SecurityGroupRule(4c4f225f-c00e-40e7-9957-537238b2be0b),SecurityGroupRule(cacf7c69-3f28-4154-9453-77d1dba4b5cc)],shared=False,stateful=True,updated_at=2022-10-16T01:02:25Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:25.693565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (47131bbf-f06f-4a48-870c-42726cd628dd), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.694198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:25Z,description=,direction='egress',ethertype='IPv6',id=4c4f225f-c00e-40e7-9957-537238b2be0b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47131bbf-f06f-4a48-870c-42726cd628dd,updated_at=2022-10-16T01:02:25Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:25.694570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4c4f225f-c00e-40e7-9957-537238b2be0b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.695820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:02:25.696508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:25Z,description=,direction='egress',ethertype='IPv4',id=cacf7c69-3f28-4154-9453-77d1dba4b5cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47131bbf-f06f-4a48-870c-42726cd628dd,updated_at=2022-10-16T01:02:25Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:25.696878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (cacf7c69-3f28-4154-9453-77d1dba4b5cc), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.697213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d9d674f4-0646-46ce-9249-468a552978f7 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:02:25.808364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c06ccae0-5fb1-4549-ad06-633c2c7953fb tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:25Z,description='',direction='ingress',ethertype='IPv4',id=dc40ae9f-c6b9-453c-bbc0-7decd186cc40,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47131bbf-f06f-4a48-870c-42726cd628dd,updated_at=2022-10-16T01:02:25Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:25.808847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c06ccae0-5fb1-4549-ad06-633c2c7953fb tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dc40ae9f-c6b9-453c-bbc0-7decd186cc40), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.809214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c06ccae0-5fb1-4549-ad06-633c2c7953fb tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:02:25.936654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc6fd585-ff2a-4998-b0bd-b4af27d04c78 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:02:25Z,description='',direction='ingress',ethertype='IPv4',id=569ad5c8-4430-43b8-aa82-e8d7f6f36493,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb3c758e27684dcd9265e2d60036d80b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47131bbf-f06f-4a48-870c-42726cd628dd,updated_at=2022-10-16T01:02:25Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:25.937026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc6fd585-ff2a-4998-b0bd-b4af27d04c78 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (569ad5c8-4430-43b8-aa82-e8d7f6f36493), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:25.937439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc6fd585-ff2a-4998-b0bd-b4af27d04c78 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:02:26.360342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5688a095-d62c-45fa-86aa-e8718f1c4a43 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:02:26Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2124aac1-2814-4b0a-bc61-9375ec62d794,mac_address=fa:16:3e:a8:89:af,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2124aac1-2814-4b0a-bc61-9375ec62d794),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:02:26Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:26.361068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5688a095-d62c-45fa-86aa-e8718f1c4a43 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (2124aac1-2814-4b0a-bc61-9375ec62d794), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:26.718066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5688a095-d62c-45fa-86aa-e8718f1c4a43 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port 2124aac1-2814-4b0a-bc61-9375ec62d794 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '6e3f3b7e-05b2-4549-bd27-04c3b61556ce'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:26.718450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5688a095-d62c-45fa-86aa-e8718f1c4a43 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (2124aac1-2814-4b0a-bc61-9375ec62d794), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:27.260998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:390 started Oct 16 01:02:27.263465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=906000000,duration_sec=813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:27.264058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:27.264403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:390 - starting polling. Elapsed:0.004 Oct 16 01:02:27.268054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:27.270506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 41018b25-ef72-4267-9902-28254b241fb5 not present in bridge br-int Oct 16 01:02:27.270847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:02:27.271331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['41018b25-ef72-4267-9902-28254b241fb5'] Oct 16 01:02:27.271663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 41018b25-ef72-4267-9902-28254b241fb5 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:02:27.276760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:390 - port information retrieved. Elapsed:0.016 Oct 16 01:02:27.277102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 16 01:02:29.262656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:391 started Oct 16 01:02:29.265172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eb8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=908000000,duration_sec=815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:29.265746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:29.266135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:29.582644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95eada7c-4112-4b84-93e4-0dddd5462792 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:02:28Z,data_plane_status=None,description='',device_id='d627f49d-f82c-43c3-a5c5-b9ce678a168d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=55fcc1bb-db7a-478d-a43e-2302d6cbccc8,mac_address=fa:16:3e:d0:8c:b3,name='',network_id=7dae3d76-90a2-41d2-9dad-7f7856d5ab85,numa_affinity_policy=,project_id='fb3c758e27684dcd9265e2d60036d80b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(55fcc1bb-db7a-478d-a43e-2302d6cbccc8),security_group_ids=set([47131bbf-f06f-4a48-870c-42726cd628dd]),status='DOWN',updated_at=2022-10-16T01:02:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:02:29.583135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95eada7c-4112-4b84-93e4-0dddd5462792 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (55fcc1bb-db7a-478d-a43e-2302d6cbccc8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:29.584415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-95eada7c-4112-4b84-93e4-0dddd5462792 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'47131bbf-f06f-4a48-870c-42726cd628dd'} Oct 16 01:02:30.069474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07705c8b-5d82-4c29-948e-35281218d3df service neutron] Resource Port 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=55fcc1bb-db7a-478d-a43e-2302d6cbccc8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=55fcc1bb-db7a-478d-a43e-2302d6cbccc8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:30.069939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07705c8b-5d82-4c29-948e-35281218d3df service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (55fcc1bb-db7a-478d-a43e-2302d6cbccc8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:30.375927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07705c8b-5d82-4c29-948e-35281218d3df service neutron] Resource Port 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=55fcc1bb-db7a-478d-a43e-2302d6cbccc8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=55fcc1bb-db7a-478d-a43e-2302d6cbccc8,segment=NetworkSegment(994bcd7f-d2ee-4126-bfcb-b7cd5780c565),segment_id=994bcd7f-d2ee-4126-bfcb-b7cd5780c565)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=55fcc1bb-db7a-478d-a43e-2302d6cbccc8,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:30.376609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07705c8b-5d82-4c29-948e-35281218d3df service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (55fcc1bb-db7a-478d-a43e-2302d6cbccc8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:31.263963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:392 started Oct 16 01:02:31.266280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=909000000,duration_sec=817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:31.266877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:31.267217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:392 - starting polling. Elapsed:0.004 Oct 16 01:02:31.270736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:31.276490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:392 - port information retrieved. Elapsed:0.013 Oct 16 01:02:31.276826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:02:32.273576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:32.275071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (55fcc1bb-db7a-478d-a43e-2302d6cbccc8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:33.264954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:393 started Oct 16 01:02:33.267490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ebc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=910000000,duration_sec=819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:33.268204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:33.268819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:393 - starting polling. Elapsed:0.004 Oct 16 01:02:33.272645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:33.278355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:393 - port information retrieved. Elapsed:0.014 Oct 16 01:02:33.280373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:02:34.291928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:02:34.293474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (55fcc1bb-db7a-478d-a43e-2302d6cbccc8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:35.265859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:394 started Oct 16 01:02:35.269280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ebe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=912000000,duration_sec=821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:35.270179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:35.270764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:394 - starting polling. Elapsed:0.005 Oct 16 01:02:35.274989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:35.280712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:394 - port information retrieved. Elapsed:0.015 Oct 16 01:02:35.281157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 01:02:37.266714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:395 started Oct 16 01:02:37.269195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ec0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=912000000,duration_sec=823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:37.269791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:37.270148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:39.268079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:396 started Oct 16 01:02:39.270514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ec2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=914000000,duration_sec=825,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:39.271143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:39.271501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:41.269197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:397 started Oct 16 01:02:41.271696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ec4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=915000000,duration_sec=827,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:41.272507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:41.272967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:42.439592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e0fb825c-e5d4-4e12-8525-bfad868f8d54 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource Port deleted: eacd06b0-a0a4-40d4-b556-dd29e648da3c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:42.440457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e0fb825c-e5d4-4e12-8525-bfad868f8d54 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (eacd06b0-a0a4-40d4-b556-dd29e648da3c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:42.440457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e0fb825c-e5d4-4e12-8525-bfad868f8d54 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group member updated {'e4a83e87-e8e3-429b-8d31-804d75d095e2'} Oct 16 01:02:43.270818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:398 started Oct 16 01:02:43.273642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ec6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=916000000,duration_sec=829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:43.274569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:43.275760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:398 - starting polling. Elapsed:0.004 Oct 16 01:02:43.282966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:43.287444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port eacd06b0-a0a4-40d4-b556-dd29e648da3c not present in bridge br-int Oct 16 01:02:43.287984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:02:43.288582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['eacd06b0-a0a4-40d4-b556-dd29e648da3c'] Oct 16 01:02:43.289109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port eacd06b0-a0a4-40d4-b556-dd29e648da3c is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:02:43.296848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:398 - port information retrieved. Elapsed:0.026 Oct 16 01:02:43.297916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Oct 16 01:02:44.149562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource SecurityGroup deleted: e4a83e87-e8e3-429b-8d31-804d75d095e2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:44.150652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (e4a83e87-e8e3-429b-8d31-804d75d095e2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:44.151459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e4a83e87-e8e3-429b-8d31-804d75d095e2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:02:44.171834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e4a83e87-e8e3-429b-8d31-804d75d095e2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:02:44.172864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource SecurityGroupRule deleted: ef18c8c4-5748-4319-9612-24239e0491b4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:44.173481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ef18c8c4-5748-4319-9612-24239e0491b4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:44.174048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 01:02:44.174558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource SecurityGroupRule deleted: f03f2dcd-d0d8-4e9d-b4b8-b712d6cf849e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:44.175062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f03f2dcd-d0d8-4e9d-b4b8-b712d6cf849e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:44.175458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 01:02:44.175905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource SecurityGroupRule deleted: c47f76a9-fa81-433a-871e-c4a2d805d50a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:44.176319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c47f76a9-fa81-433a-871e-c4a2d805d50a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:44.176711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 01:02:44.177153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource SecurityGroupRule deleted: 1aff11b8-308a-4bb0-8b00-d397963cbe65 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:44.177562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1aff11b8-308a-4bb0-8b00-d397963cbe65), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:44.177953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-29c6e0ac-e25c-468a-b814-de71bc7ef011 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group rule updated ['e4a83e87-e8e3-429b-8d31-804d75d095e2'] Oct 16 01:02:44.581687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bce3b864-735f-4b65-852f-9423652447ca tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource Port deleted: 2c0e6747-ef98-4449-8da2-0b70d32a7b71 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:44.586321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bce3b864-735f-4b65-852f-9423652447ca tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (2c0e6747-ef98-4449-8da2-0b70d32a7b71), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:45.272012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:399 started Oct 16 01:02:45.274577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ec8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=918000000,duration_sec=831,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:45.275918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:45.276266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:399 - starting polling. Elapsed:0.005 Oct 16 01:02:45.279898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:45.282363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 2c0e6747-ef98-4449-8da2-0b70d32a7b71 not present in bridge br-int Oct 16 01:02:45.282710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:02:45.283144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['2c0e6747-ef98-4449-8da2-0b70d32a7b71'] Oct 16 01:02:45.283478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 2c0e6747-ef98-4449-8da2-0b70d32a7b71 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:02:45.288432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:399 - port information retrieved. Elapsed:0.017 Oct 16 01:02:45.288787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Oct 16 01:02:47.273243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:400 started Oct 16 01:02:47.276649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=919000000,duration_sec=833,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:47.277613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:47.278117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:02:49.274709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:401 started Oct 16 01:02:49.277226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ecc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=920000000,duration_sec=835,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:49.277804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:49.278167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:50.098378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e5ab5078-c1d2-49f3-b0dd-51a1150ea8c2 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource Port deleted: e6727a07-61b9-4fef-83e4-902cce857bee {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:50.099142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e5ab5078-c1d2-49f3-b0dd-51a1150ea8c2 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (e6727a07-61b9-4fef-83e4-902cce857bee), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:50.099791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e5ab5078-c1d2-49f3-b0dd-51a1150ea8c2 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group member updated {'2373011f-2524-4861-b686-1d88cdba9ae8'} Oct 16 01:02:51.275925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:402 started Oct 16 01:02:51.278337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ece,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=921000000,duration_sec=837,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:51.278944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:51.279287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:402 - starting polling. Elapsed:0.004 Oct 16 01:02:51.282806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:51.285300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port e6727a07-61b9-4fef-83e4-902cce857bee not present in bridge br-int Oct 16 01:02:51.285645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:02:51.285935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['e6727a07-61b9-4fef-83e4-902cce857bee'] Oct 16 01:02:51.286264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port e6727a07-61b9-4fef-83e4-902cce857bee is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:02:51.291303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:402 - port information retrieved. Elapsed:0.016 Oct 16 01:02:51.291643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 16 01:02:53.276682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:403 started Oct 16 01:02:53.279172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ed0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=922000000,duration_sec=839,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:53.279766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:53.280121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:55.277937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:404 started Oct 16 01:02:55.280316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ed2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=923000000,duration_sec=841,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:55.280905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:55.281256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:02:55.971822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b271ce27-3a91-41ec-8ede-5cbd0a774835 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Resource Port deleted: 37a89ecc-65c3-483a-b753-8ddbd32b4132 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:55.972787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b271ce27-3a91-41ec-8ede-5cbd0a774835 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (37a89ecc-65c3-483a-b753-8ddbd32b4132), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:55.974076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b271ce27-3a91-41ec-8ede-5cbd0a774835 tempest-ServerRescueNegativeTestJSON-1271918241 tempest-ServerRescueNegativeTestJSON-1271918241-project] Security group member updated {'2373011f-2524-4861-b686-1d88cdba9ae8'} Oct 16 01:02:57.279345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:405 started Oct 16 01:02:57.283972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ed4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=925000000,duration_sec=843,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:57.284981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:57.285580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:405 - starting polling. Elapsed:0.006 Oct 16 01:02:57.292976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:57.297580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 37a89ecc-65c3-483a-b753-8ddbd32b4132 not present in bridge br-int Oct 16 01:02:57.298131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:02:57.298591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['37a89ecc-65c3-483a-b753-8ddbd32b4132'] Oct 16 01:02:57.299155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 37a89ecc-65c3-483a-b753-8ddbd32b4132 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:02:57.309329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:405 - port information retrieved. Elapsed:0.030 Oct 16 01:02:57.309863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.031 Oct 16 01:02:58.074836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b016d69b-bdd5-46cf-a421-cdcd146cacbe admin admin] Resource Port deleted: d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:58.074836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b016d69b-bdd5-46cf-a421-cdcd146cacbe admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:59.280352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:406 started Oct 16 01:02:59.285843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ed6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=929000000,duration_sec=845,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:59.286422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:02:59.286832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:406 - starting polling. Elapsed:0.007 Oct 16 01:02:59.290691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:02:59.296403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6c9e7b3-8f, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:02:59.308380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416ed8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:02:59.309102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6'] Oct 16 01:02:59.309719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:02:59.380292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c23cf4-7c2c-4131-9549-48789169e01e]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:02:59.387220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:406 - port information retrieved. Elapsed:0.107 Oct 16 01:02:59.390446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.110 Oct 16 01:02:59.529984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b571a249-640d-4cdf-bef6-81cea86b2c2a","delete","qr-d6c9e7b3-8f",17,["map",[["attached-mac","fa:16:3e:5c:27:e8"],["iface-id","d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:02:59.708014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3669632c-4277-487f-9b91-eb14a91565bb admin admin] Resource Port deleted: 42633501-06b6-4c52-92d4-45822c5b414e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:02:59.708485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3669632c-4277-487f-9b91-eb14a91565bb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (42633501-06b6-4c52-92d4-45822c5b414e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:00.242025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b13bccb3-d36a-4120-aa91-aa93b8a8352b","delete","qg-42633501-06",11,["map",[["attached-mac","fa:16:3e:1d:66:42"],["iface-id","42633501-06b6-4c52-92d4-45822c5b414e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:00.552577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-67899a0a-9ee7-445f-ae84-02f80a82c38c admin admin] Resource Subnet deleted: a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:00.553518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-67899a0a-9ee7-445f-ae84-02f80a82c38c admin admin] Publish callbacks [] for Subnet (a3d57f4d-0fa0-4b1e-88f5-f9f6b52bf60c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:00.706425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bfd6f8a9-b20b-48f8-9683-044db1522922","delete","tap29057d15-83",9,["map",[["attached-mac","fa:16:3e:3b:c4:36"],["iface-id","29057d15-832d-4bc1-939a-b77306acef22"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:00.892529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f4eaa91-50ae-4f53-859a-b40674702d4a admin admin] Resource Port deleted: 29057d15-832d-4bc1-939a-b77306acef22 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:00.893251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f4eaa91-50ae-4f53-859a-b40674702d4a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (29057d15-832d-4bc1-939a-b77306acef22), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.008793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-40382fb7-58ab-464d-b51d-0e089c1bcdf4 None None] Resource Port deleted: 29057d15-832d-4bc1-939a-b77306acef22 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.009134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-40382fb7-58ab-464d-b51d-0e089c1bcdf4 None None] Skipped duplicate delete event for 29057d15-832d-4bc1-939a-b77306acef22 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 01:03:01.259746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f4eaa91-50ae-4f53-859a-b40674702d4a admin admin] Resource Network deleted: f6d9aa56-b330-4b62-a416-c067206c96f0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.261016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f4eaa91-50ae-4f53-859a-b40674702d4a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (f6d9aa56-b330-4b62-a416-c067206c96f0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.280911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:407 started Oct 16 01:03:01.285130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=927000000,duration_sec=847,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:01.285813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:01.286434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:407 - starting polling. Elapsed:0.006 Oct 16 01:03:01.292396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.300208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416edc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:01.301791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416ede,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:01.305965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416ee0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:01.306280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:407 - port information retrieved. Elapsed:0.026 Oct 16 01:03:01.306633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56'}, 'added': set(), 'removed': {'29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '42633501-06b6-4c52-92d4-45822c5b414e'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:01.307147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:407 - agent port security group processed in 0.000 Oct 16 01:03:01.310238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:03:01.310551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '42633501-06b6-4c52-92d4-45822c5b414e'} Oct 16 01:03:01.310978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:01.311410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:01.356310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2f9cbe-fa34-4960-b5a5-3951570ca38e]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:01.357072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'29057d15-832d-4bc1-939a-b77306acef22', 'd6c9e7b3-8f45-4467-bd7c-c4c2819d7fa6', '42633501-06b6-4c52-92d4-45822c5b414e'} removed Oct 16 01:03:01.433795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:03:01.434232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 5 from net-id = f6d9aa56-b330-4b62-a416-c067206c96f0, seg-id = 384 Oct 16 01:03:01.436886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8c99,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:01.439217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416ee2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4480}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:01.439593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:01.439944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:407 - treat_devices_removed completed in 0.129 Oct 16 01:03:01.440262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:407 - ports processed. Elapsed:0.160 Oct 16 01:03:01.440591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.160 Oct 16 01:03:01.582142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Resource SecurityGroup deleted: 2373011f-2524-4861-b686-1d88cdba9ae8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.582772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (2373011f-2524-4861-b686-1d88cdba9ae8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.583047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2373011f-2524-4861-b686-1d88cdba9ae8',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:01.596859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2373011f-2524-4861-b686-1d88cdba9ae8',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:01.597619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Resource SecurityGroupRule deleted: 0b217338-8e3e-431e-9f0f-8f2c341ef1a7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.598008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0b217338-8e3e-431e-9f0f-8f2c341ef1a7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.598693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 01:03:01.599258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Resource SecurityGroupRule deleted: 3edd512b-a2a2-47d2-b6ef-a8648f1103b4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.599620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3edd512b-a2a2-47d2-b6ef-a8648f1103b4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.599952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 01:03:01.600335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Resource SecurityGroupRule deleted: 4e79adc1-d6b3-4b40-b895-4f3f03ca1912 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.600688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4e79adc1-d6b3-4b40-b895-4f3f03ca1912), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.601016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 01:03:01.601393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Resource SecurityGroupRule deleted: 5eb229dd-e11a-4218-b94f-6b9455c552cd {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:01.601749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5eb229dd-e11a-4218-b94f-6b9455c552cd), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:01.602096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-715ebd8f-a02c-443c-bb8f-2674c0e684d9 admin admin] Security group rule updated ['2373011f-2524-4861-b686-1d88cdba9ae8'] Oct 16 01:03:02.613678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:03:02Z,description='Default security group',id=7a279710-7506-4f0c-bac4-6c2b0f088046,is_default=True,name='default',project_id='b8852bfe31aa4ba68190661d26c177cb',revision_number=1,rules=[SecurityGroupRule(13acf2b5-a428-4028-84c3-55c31869da29),SecurityGroupRule(36dd0d8a-cf3a-414c-b8fc-5a5181b0176f),SecurityGroupRule(c661cf59-5106-4b36-8e2f-a39709112515),SecurityGroupRule(dc2fec1f-48eb-42c8-8e23-5192509b6379)],shared=False,stateful=True,updated_at=2022-10-16T01:03:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:02.614277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (7a279710-7506-4f0c-bac4-6c2b0f088046), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:02.614696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:02Z,description=,direction='ingress',ethertype='IPv6',id=13acf2b5-a428-4028-84c3-55c31869da29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=7a279710-7506-4f0c-bac4-6c2b0f088046,remote_ip_prefix=,revision_number=0,security_group_id=7a279710-7506-4f0c-bac4-6c2b0f088046,updated_at=2022-10-16T01:03:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:02.615102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (13acf2b5-a428-4028-84c3-55c31869da29), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:02.615446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:03:02.616132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:02Z,description=,direction='ingress',ethertype='IPv4',id=36dd0d8a-cf3a-414c-b8fc-5a5181b0176f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=7a279710-7506-4f0c-bac4-6c2b0f088046,remote_ip_prefix=,revision_number=0,security_group_id=7a279710-7506-4f0c-bac4-6c2b0f088046,updated_at=2022-10-16T01:03:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:02.616499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (36dd0d8a-cf3a-414c-b8fc-5a5181b0176f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:02.616834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:03:02.617498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:02Z,description=,direction='egress',ethertype='IPv6',id=c661cf59-5106-4b36-8e2f-a39709112515,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a279710-7506-4f0c-bac4-6c2b0f088046,updated_at=2022-10-16T01:03:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:02.617922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c661cf59-5106-4b36-8e2f-a39709112515), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:02.618255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:03:02.619089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:02Z,description=,direction='egress',ethertype='IPv4',id=dc2fec1f-48eb-42c8-8e23-5192509b6379,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a279710-7506-4f0c-bac4-6c2b0f088046,updated_at=2022-10-16T01:03:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:02.619437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dc2fec1f-48eb-42c8-8e23-5192509b6379), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:02.619773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:03:02.761089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T01:03:02Z,description='',dns_domain=None,id=57335160-65ed-4241-a862-dbf37da52fd2,mtu=1500,name='tempest-AttachVolumeTestJSON-1096901518-network',project_id='b8852bfe31aa4ba68190661d26c177cb',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(57335160-65ed-4241-a862-dbf37da52fd2),segments=[NetworkSegment(a2b144b3-1489-4a11-bdb8-6be66ef8e43c)],shared=False,status='ACTIVE',updated_at=2022-10-16T01:03:02Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:02.761572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (57335160-65ed-4241-a862-dbf37da52fd2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-24740d75-6181-4ebe-ac5a-13cf330a8d38 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 57335160-65ed-4241-a862-dbf37da52fd2 with segmentation id not found. Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 01:03:02.982467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 01:03:02.983714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 01:03:02.983714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 01:03:02.983714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 01:03:02.983714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 57335160-65ed-4241-a862-dbf37da52fd2 with segmentation id not found. Oct 16 01:03:02.983714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 01:03:03.052439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2b8f52dd-2b12-4f34-9d23-d5aaf48fa5fe admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(a533fe68-bb59-45f7-a350-e2faeb3beaa7)],cidr=172.20.0.0/28,created_at=2022-10-16T01:03:02Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=ddb48e42-3d61-453a-90ed-9d67363fcb4f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-1096901518-subnet',network_id=57335160-65ed-4241-a862-dbf37da52fd2,project_id='b8852bfe31aa4ba68190661d26c177cb',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T01:03:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:03.053076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2b8f52dd-2b12-4f34-9d23-d5aaf48fa5fe admin admin] Publish callbacks [] for Subnet (ddb48e42-3d61-453a-90ed-9d67363fcb4f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:03.282378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:408 started Oct 16 01:03:03.285473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ee4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=928000000,duration_sec=849,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:03.286200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:03.286913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:03:03.609509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-941b2d82-99b9-46c5-b77a-0fc6014afdc4 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:03Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-57335160-65ed-4241-a862-dbf37da52fd2',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3fff1000-da0b-466d-9856-c4fcdcbd4c2e,mac_address=fa:16:3e:79:43:9e,name='',network_id=57335160-65ed-4241-a862-dbf37da52fd2,numa_affinity_policy=,project_id='b8852bfe31aa4ba68190661d26c177cb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3fff1000-da0b-466d-9856-c4fcdcbd4c2e),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:03:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:03.610184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-941b2d82-99b9-46c5-b77a-0fc6014afdc4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3fff1000-da0b-466d-9856-c4fcdcbd4c2e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:03.888582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-941b2d82-99b9-46c5-b77a-0fc6014afdc4 None None] Resource Port 3fff1000-da0b-466d-9856-c4fcdcbd4c2e updated (revision_number 1->2). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3fff1000-da0b-466d-9856-c4fcdcbd4c2e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3fff1000-da0b-466d-9856-c4fcdcbd4c2e,segment=NetworkSegment(a2b144b3-1489-4a11-bdb8-6be66ef8e43c),segment_id=a2b144b3-1489-4a11-bdb8-6be66ef8e43c)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3fff1000-da0b-466d-9856-c4fcdcbd4c2e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:03.889292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-941b2d82-99b9-46c5-b77a-0fc6014afdc4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3fff1000-da0b-466d-9856-c4fcdcbd4c2e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:03.972300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["42b6ceae-84a9-4ec0-a981-e00037c14331","insert","tap3fff1000-da",["set",[]],["map",[["attached-mac","fa:16:3e:79:43:9e"],["iface-id","3fff1000-da0b-466d-9856-c4fcdcbd4c2e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:03.994619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["42b6ceae-84a9-4ec0-a981-e00037c14331","old",null,["set",[]],null],["","new","tap3fff1000-da",36,["map",[["attached-mac","fa:16:3e:79:43:9e"],["iface-id","3fff1000-da0b-466d-9856-c4fcdcbd4c2e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:04.124089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6502d280-e56f-4814-b694-1bc6d4b98eef admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:03Z,data_plane_status=None,description='',device_id='70ef0714-e67f-4232-a8b3-97d360f21c38',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,mac_address=fa:16:3e:74:73:64,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:03:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:04.124567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6502d280-e56f-4814-b694-1bc6d4b98eef admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:05.285704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:409 started Oct 16 01:03:05.289272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ee6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=932000000,duration_sec=851,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:05.290331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:05.295720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:409 - starting polling. Elapsed:0.005 Oct 16 01:03:05.295720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:05.301446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:409 - port information retrieved. Elapsed:0.016 Oct 16 01:03:05.301946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': {'3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'removed': set(), 'updated': {'3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:05.302665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-57335160-65ed-4241-a862-dbf37da52fd2', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'mac_address': 'fa:16:3e:79:43:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:03:05.308872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 3fff1000-da0b-466d-9856-c4fcdcbd4c2e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:05.309337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3fff1000-da0b-466d-9856-c4fcdcbd4c2e updated. Details: {'device': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-57335160-65ed-4241-a862-dbf37da52fd2', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'mac_address': 'fa:16:3e:79:43:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Oct 16 01:03:05.309969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Assigning 14 as local vlan for net-id=57335160-65ed-4241-a862-dbf37da52fd2, seg-id=359 Oct 16 01:03:05.313974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xd17e8c9b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=3824201269964127989,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4455), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:05.317128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x79416ee8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4455}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:05.318269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3fff1000-da, col_values=(('tag', 14),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:05.318988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap3fff1000-da, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:05.319655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap3fff1000-da, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:05.333788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3fff1000-da, col_values=(('other_config', {'net_uuid': '57335160-65ed-4241-a862-dbf37da52fd2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '359'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:05.346167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416eea,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:05.346924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:409 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 29 devices currently available. Time elapsed: 0.045 Oct 16 01:03:05.347367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:03:05.347766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'3fff1000-da0b-466d-9856-c4fcdcbd4c2e'} Oct 16 01:03:05.349151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:03:05.349513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:03:05.357581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:05.377589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bbbb14b4-e983-476a-9dc6-6b3b1a5b9e35 None None] Resource Port 3fff1000-da0b-466d-9856-c4fcdcbd4c2e updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:05.378339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bbbb14b4-e983-476a-9dc6-6b3b1a5b9e35 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (3fff1000-da0b-466d-9856-c4fcdcbd4c2e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:05.419261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62e29e5-fc32-4d18-a04d-a882f0863497]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:05.420120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:409 - agent port security group processed in 0.118 Oct 16 01:03:05.421476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 3fff1000-da0b-466d-9856-c4fcdcbd4c2e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:03:05.831413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b48cbd2b-137c-4535-a02a-a7706bbc3760 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:05Z,data_plane_status=None,description='',device_id='70ef0714-e67f-4232-a8b3-97d360f21c38',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a0f3de46-77fa-4767-8d04-a86666829119,mac_address=fa:16:3e:0a:6f:90,name='',network_id=57335160-65ed-4241-a862-dbf37da52fd2,numa_affinity_policy=,project_id='b8852bfe31aa4ba68190661d26c177cb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a0f3de46-77fa-4767-8d04-a86666829119),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:03:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:05.833955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b48cbd2b-137c-4535-a02a-a7706bbc3760 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a0f3de46-77fa-4767-8d04-a86666829119), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:05.837838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['3fff1000-da0b-466d-9856-c4fcdcbd4c2e'] and devices down [] completed. Oct 16 01:03:05.838166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:409 - ports processed. Elapsed:0.553 Oct 16 01:03:05.838513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.553 Oct 16 01:03:06.033660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c8755759-33b3-48eb-9378-62bf0d6bfb85 None None] Resource Port d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:06.035150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c8755759-33b3-48eb-9378-62bf0d6bfb85 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:06.330831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c8755759-33b3-48eb-9378-62bf0d6bfb85 None None] Resource Port d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:06.334135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c8755759-33b3-48eb-9378-62bf0d6bfb85 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:06.385591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b48cbd2b-137c-4535-a02a-a7706bbc3760 admin admin] Received resource Port update without any changes: a0f3de46-77fa-4767-8d04-a86666829119 {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Oct 16 01:03:06.984432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["163eb689-4fcd-4693-aca7-6425d9173f02","insert","qr-a0f3de46-77",["set",[]],["map",[["attached-mac","fa:16:3e:0a:6f:90"],["iface-id","a0f3de46-77fa-4767-8d04-a86666829119"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:07.004897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["163eb689-4fcd-4693-aca7-6425d9173f02","old",null,["set",[]],null],["","new","qr-a0f3de46-77",37,["map",[["attached-mac","fa:16:3e:0a:6f:90"],["iface-id","a0f3de46-77fa-4767-8d04-a86666829119"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:07.286246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:410 started Oct 16 01:03:07.289234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416eec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=932000000,duration_sec=853,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:07.290415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:07.290941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:410 - starting polling. Elapsed:0.005 Oct 16 01:03:07.294686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:07.300043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:410 - port information retrieved. Elapsed:0.014 Oct 16 01:03:07.300403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': {'a0f3de46-77fa-4767-8d04-a86666829119'}, 'removed': set(), 'updated': {'3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'a0f3de46-77fa-4767-8d04-a86666829119'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:07.300987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-57335160-65ed-4241-a862-dbf37da52fd2', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'mac_address': 'fa:16:3e:79:43:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:03:07.301599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:05Z,data_plane_status=None,description='',device_id='70ef0714-e67f-4232-a8b3-97d360f21c38',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a0f3de46-77fa-4767-8d04-a86666829119,mac_address=fa:16:3e:0a:6f:90,name='',network_id=57335160-65ed-4241-a862-dbf37da52fd2,numa_affinity_policy=,project_id='b8852bfe31aa4ba68190661d26c177cb',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(a0f3de46-77fa-4767-8d04-a86666829119),security_group_ids=set([]),status='DOWN',updated_at=2022-10-16T01:03:06Z) is not bound. Oct 16 01:03:07.307962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: 3fff1000-da0b-466d-9856-c4fcdcbd4c2e {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:07.308605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3fff1000-da0b-466d-9856-c4fcdcbd4c2e updated. Details: {'device': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-57335160-65ed-4241-a862-dbf37da52fd2', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'mac_address': 'fa:16:3e:79:43:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 16 01:03:07.309808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3fff1000-da, col_values=(('tag', 14),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:07.310460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap3fff1000-da, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:07.310817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap3fff1000-da, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:07.311740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:03:07.312789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3fff1000-da, col_values=(('other_config', {'net_uuid': '57335160-65ed-4241-a862-dbf37da52fd2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '359', 'tag': '14'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:07.313917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:03:07.322343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:03:07Z,description='tempest-description--467616368',id=56de6e02-e079-44a1-8388-7aaeb8270eaf,is_default=False,name='tempest-securitygroup--269443264',project_id='b8852bfe31aa4ba68190661d26c177cb',revision_number=1,rules=[SecurityGroupRule(5a064834-6cfa-42f0-a6fe-ebefae60c38d),SecurityGroupRule(d3050b82-b458-4cf2-83af-bb6fd66400c5)],shared=False,stateful=True,updated_at=2022-10-16T01:03:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:07.322343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (56de6e02-e079-44a1-8388-7aaeb8270eaf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:07.323817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:07Z,description=,direction='egress',ethertype='IPv4',id=5a064834-6cfa-42f0-a6fe-ebefae60c38d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56de6e02-e079-44a1-8388-7aaeb8270eaf,updated_at=2022-10-16T01:03:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:07.323817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5a064834-6cfa-42f0-a6fe-ebefae60c38d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:07.323817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:03:07.325912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:07Z,description=,direction='egress',ethertype='IPv6',id=d3050b82-b458-4cf2-83af-bb6fd66400c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56de6e02-e079-44a1-8388-7aaeb8270eaf,updated_at=2022-10-16T01:03:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:07.325912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d3050b82-b458-4cf2-83af-bb6fd66400c5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:07.325912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-656513f7-e2f3-4ec4-9722-efaca5c55f7f tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:03:07.326190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416eee,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:07.326190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: a0f3de46-77fa-4767-8d04-a86666829119 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:07.326190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Device a0f3de46-77fa-4767-8d04-a86666829119 not defined on plugin or binding failed Oct 16 01:03:07.327925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:410 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 30 devices currently available. Time elapsed: 0.026 Oct 16 01:03:07.327925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:03:07.327925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'a0f3de46-77fa-4767-8d04-a86666829119'} Oct 16 01:03:07.328449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:03:07.328734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:03:07.335636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:03:07.336305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:03:07.338089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:03:07.338576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:03:07.345041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:07.409420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c065ce-fa3f-493a-83b1-b874d1522ec2]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:07.410246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:410 - agent port security group processed in 0.109 Oct 16 01:03:07.411437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for 3fff1000-da0b-466d-9856-c4fcdcbd4c2e to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:03:07.516126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c6aa38e9-ecf8-4bc8-beef-3f87f2c6220e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:07Z,description='',direction='ingress',ethertype='IPv4',id=72d38621-4a25-4604-99fa-3f1b5ee8e552,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56de6e02-e079-44a1-8388-7aaeb8270eaf,updated_at=2022-10-16T01:03:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:07.516560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c6aa38e9-ecf8-4bc8-beef-3f87f2c6220e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (72d38621-4a25-4604-99fa-3f1b5ee8e552), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:07.516929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c6aa38e9-ecf8-4bc8-beef-3f87f2c6220e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:03:07.519206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d1f1c75f-4f7c-46e4-8bc3-58bc7e221981","insert","qg-d48c3a5e-a5",["set",[]],["map",[["attached-mac","fa:16:3e:74:73:64"],["iface-id","d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:07.552877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d1f1c75f-4f7c-46e4-8bc3-58bc7e221981","old",null,["set",[]],null],["","new","qg-d48c3a5e-a5",38,["map",[["attached-mac","fa:16:3e:74:73:64"],["iface-id","d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:07.707443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['3fff1000-da0b-466d-9856-c4fcdcbd4c2e'] and devices down [] completed. Oct 16 01:03:07.708025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:410 - ports processed. Elapsed:0.422 Oct 16 01:03:07.708526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.422 Oct 16 01:03:08.064211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c12e96a0-8ce6-4c34-af62-bced0bb26592 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:07Z,description='',direction='ingress',ethertype='IPv4',id=1b1b654a-a34b-481d-9788-98f22ee5a68a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56de6e02-e079-44a1-8388-7aaeb8270eaf,updated_at=2022-10-16T01:03:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:08.064869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c12e96a0-8ce6-4c34-af62-bced0bb26592 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1b1b654a-a34b-481d-9788-98f22ee5a68a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:08.065544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c12e96a0-8ce6-4c34-af62-bced0bb26592 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:03:08.557229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3989307-3edc-42ed-a322-e512f7798d1e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:08Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e7c812e1-34db-4018-99c1-10152ebd52ad,mac_address=fa:16:3e:b3:6c:e5,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e7c812e1-34db-4018-99c1-10152ebd52ad),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:03:08Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:08.558326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3989307-3edc-42ed-a322-e512f7798d1e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e7c812e1-34db-4018-99c1-10152ebd52ad), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:08.657862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-12dd6158-cbf9-4ee3-870b-3b08c42e0ded tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port deleted: 1cc7e38e-e043-419a-986d-342c38dba97f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:08.659382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-12dd6158-cbf9-4ee3-870b-3b08c42e0ded tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (1cc7e38e-e043-419a-986d-342c38dba97f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:08.660241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-12dd6158-cbf9-4ee3-870b-3b08c42e0ded tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group member updated {'04a6f405-fb32-4245-a68e-14ecec65861c'} Oct 16 01:03:09.023982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f3989307-3edc-42ed-a322-e512f7798d1e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource Port e7c812e1-34db-4018-99c1-10152ebd52ad updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '8bff6219-aaf0-47cd-8812-d229d7337011'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:09.024668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f3989307-3edc-42ed-a322-e512f7798d1e tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e7c812e1-34db-4018-99c1-10152ebd52ad), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:09.287802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:411 started Oct 16 01:03:09.291554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ef0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=934000000,duration_sec=855,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:09.292906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:09.293795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:411 - starting polling. Elapsed:0.006 Oct 16 01:03:09.302123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:09.305733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1cc7e38e-e043-419a-986d-342c38dba97f not present in bridge br-int Oct 16 01:03:09.306260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:09.306428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['1cc7e38e-e043-419a-986d-342c38dba97f'] Oct 16 01:03:09.306722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1cc7e38e-e043-419a-986d-342c38dba97f is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:09.313033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:411 - port information retrieved. Elapsed:0.025 Oct 16 01:03:09.313731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': {'d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:09.314594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'mac_address': 'fa:16:3e:74:73:64', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:03:09.320252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:09.321356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 updated. Details: {'device': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'mac_address': 'fa:16:3e:74:73:64', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:03:09.323648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d48c3a5e-a5, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:09.324112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d48c3a5e-a5, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:09.324556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d48c3a5e-a5, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:09.354437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d48c3a5e-a5, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:09.380145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416ef2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:09.382433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:411 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.066 Oct 16 01:03:09.382826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing device filters for 1 new devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Oct 16 01:03:09.383745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Preparing filters for devices {'d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8'} Oct 16 01:03:09.387059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:03:09.387354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:03:09.406717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:09.485581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdebc5f3-0c74-48a2-b492-6e4693656d12]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:09.486239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:411 - agent port security group processed in 0.172 Oct 16 01:03:09.487443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:03:09.912810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8'] and devices down [] completed. Oct 16 01:03:09.913463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:411 - ports processed. Elapsed:0.626 Oct 16 01:03:09.913752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.626 Oct 16 01:03:10.032954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8,segment=NetworkSegment(90ae8863-1d1b-4c01-9b2a-3eb157dfed09),segment_id=90ae8863-1d1b-4c01-9b2a-3eb157dfed09)], 'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:10.033452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:10.643726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d332baf-2b50-4156-b579-1f71d94f554e None None] Resource Port a0f3de46-77fa-4767-8d04-a86666829119 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a0f3de46-77fa-4767-8d04-a86666829119,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a0f3de46-77fa-4767-8d04-a86666829119,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:10.644706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d332baf-2b50-4156-b579-1f71d94f554e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a0f3de46-77fa-4767-8d04-a86666829119), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:10.915409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d332baf-2b50-4156-b579-1f71d94f554e None None] Resource Port a0f3de46-77fa-4767-8d04-a86666829119 updated (revision_number 3->4). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a0f3de46-77fa-4767-8d04-a86666829119,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a0f3de46-77fa-4767-8d04-a86666829119,segment=NetworkSegment(a2b144b3-1489-4a11-bdb8-6be66ef8e43c),segment_id=a2b144b3-1489-4a11-bdb8-6be66ef8e43c)], 'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a0f3de46-77fa-4767-8d04-a86666829119,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:10.916619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d332baf-2b50-4156-b579-1f71d94f554e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a0f3de46-77fa-4767-8d04-a86666829119), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:11.289903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:412 started Oct 16 01:03:11.296348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ef4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=938000000,duration_sec=857,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:11.298090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:11.299257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:412 - starting polling. Elapsed:0.010 Oct 16 01:03:11.311455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:11.317972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:412 - port information retrieved. Elapsed:0.029 Oct 16 01:03:11.318499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': set(), 'updated': {'d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'a0f3de46-77fa-4767-8d04-a86666829119'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:11.319313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'mac_address': 'fa:16:3e:74:73:64', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:03:11.319915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'a0f3de46-77fa-4767-8d04-a86666829119', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': 'a0f3de46-77fa-4767-8d04-a86666829119', 'mac_address': 'fa:16:3e:0a:6f:90', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:03:11.326097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:11.326593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 updated. Details: {'device': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'port_id': 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'mac_address': 'fa:16:3e:74:73:64', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'f389a4ac-f37a-4f23-8d43-f4bb31e23900', 'ip_address': '172.37.2.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Oct 16 01:03:11.327986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d48c3a5e-a5, col_values=(('tag', 2),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.328542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d48c3a5e-a5, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.329049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d48c3a5e-a5, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.329674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:03:11.331041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d48c3a5e-a5, col_values=(('other_config', {'net_uuid': '208c62ac-592a-4dec-a1cf-31599d23bbee', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.331776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:03:11.334335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416ef6,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:11.334798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: a0f3de46-77fa-4767-8d04-a86666829119 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:11.335293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a0f3de46-77fa-4767-8d04-a86666829119 updated. Details: {'device': 'a0f3de46-77fa-4767-8d04-a86666829119', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': 'a0f3de46-77fa-4767-8d04-a86666829119', 'mac_address': 'fa:16:3e:0a:6f:90', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 16 01:03:11.337142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a0f3de46-77, col_values=(('tag', 14),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.337895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a0f3de46-77, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.338499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a0f3de46-77, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.348791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a0f3de46-77, col_values=(('other_config', {'net_uuid': '57335160-65ed-4241-a862-dbf37da52fd2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '359'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:11.357565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416ef8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:11.357923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:412 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.039 Oct 16 01:03:11.358453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 2 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:03:11.358994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:03:11.360890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:03:11.361183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:03:11.370012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:11.436998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed15588-ed0b-4fe3-ad38-cffd1cb70149]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:11.437770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:412 - agent port security group processed in 0.119 Oct 16 01:03:11.438943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:03:11.439400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for a0f3de46-77fa-4767-8d04-a86666829119 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:03:11.851731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'a0f3de46-77fa-4767-8d04-a86666829119'] and devices down [] completed. Oct 16 01:03:11.852063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:412 - ports processed. Elapsed:0.563 Oct 16 01:03:11.852408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.563 Oct 16 01:03:11.963395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Resource Port a0f3de46-77fa-4767-8d04-a86666829119 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:11.964134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95cad962-f418-45be-9179-4cc8fc4bf38b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a0f3de46-77fa-4767-8d04-a86666829119), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:12.549391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:12.550586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:13.245944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a5771914-74fa-4798-beac-dd3715356b63 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:12Z,data_plane_status=None,description='',device_id='f3182305-f754-4b0f-989d-7362967cb10a',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=01028fe7-7644-4a03-bb34-6762d2043774,mac_address=fa:16:3e:d5:26:7b,name='',network_id=57335160-65ed-4241-a862-dbf37da52fd2,numa_affinity_policy=,project_id='b8852bfe31aa4ba68190661d26c177cb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(01028fe7-7644-4a03-bb34-6762d2043774),security_group_ids=set([56de6e02-e079-44a1-8388-7aaeb8270eaf]),status='DOWN',updated_at=2022-10-16T01:03:12Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:13.247859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a5771914-74fa-4798-beac-dd3715356b63 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (01028fe7-7644-4a03-bb34-6762d2043774), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:13.249008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a5771914-74fa-4798-beac-dd3715356b63 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group member updated {'56de6e02-e079-44a1-8388-7aaeb8270eaf'} Oct 16 01:03:13.297375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:413 started Oct 16 01:03:13.313153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416efa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=948000000,duration_sec=859,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:13.314065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:13.314591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:413 - starting polling. Elapsed:0.019 Oct 16 01:03:13.322406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:13.330198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:413 - port information retrieved. Elapsed:0.035 Oct 16 01:03:13.343243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', 'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': set(), 'updated': {'a0f3de46-77fa-4767-8d04-a86666829119'}, 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:13.344993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Returning: {'device': 'a0f3de46-77fa-4767-8d04-a86666829119', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': 'a0f3de46-77fa-4767-8d04-a86666829119', 'mac_address': 'fa:16:3e:0a:6f:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=105601) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Oct 16 01:03:13.353438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing port: a0f3de46-77fa-4767-8d04-a86666829119 {{(pid=105601) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Oct 16 01:03:13.354177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a0f3de46-77fa-4767-8d04-a86666829119 updated. Details: {'device': 'a0f3de46-77fa-4767-8d04-a86666829119', 'device_id': '70ef0714-e67f-4232-a8b3-97d360f21c38', 'network_id': '57335160-65ed-4241-a862-dbf37da52fd2', 'port_id': 'a0f3de46-77fa-4767-8d04-a86666829119', 'mac_address': 'fa:16:3e:0a:6f:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 359, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'ddb48e42-3d61-453a-90ed-9d67363fcb4f', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Oct 16 01:03:13.356369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a0f3de46-77, col_values=(('tag', 14),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:13.357014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a0f3de46-77, column=vlan_mode) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:13.357413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a0f3de46-77, column=trunks) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:13.357864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:03:13.359170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a0f3de46-77, col_values=(('other_config', {'net_uuid': '57335160-65ed-4241-a862-dbf37da52fd2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '359', 'tag': '14'}),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:13.359865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Oct 16 01:03:13.365404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416efc,OFPFlowMod(buffer_id=4294967295,command=4,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:13.365404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:413 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 31 devices currently available. Time elapsed: 0.018 Oct 16 01:03:13.365404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refreshing firewall for 1 devices {{(pid=105601) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Oct 16 01:03:13.365404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Refresh firewall rules Oct 16 01:03:13.365404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information for ports dict_keys([]) {{(pid=105601) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Oct 16 01:03:13.365931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Update security group information {{(pid=105601) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Oct 16 01:03:13.376409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 2 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:13.480951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d34705-825f-4d54-beb0-fe2978451762]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:13.481868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:413 - agent port security group processed in 0.138 Oct 16 01:03:13.483184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Setting status for a0f3de46-77fa-4767-8d04-a86666829119 to UP {{(pid=105601) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Oct 16 01:03:13.749613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up ['a0f3de46-77fa-4767-8d04-a86666829119'] and devices down [] completed. Oct 16 01:03:13.750109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:413 - ports processed. Elapsed:0.455 Oct 16 01:03:13.750642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.455 Oct 16 01:03:13.965776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a0f21133-526d-443e-bdca-f8a461812577 service neutron] Resource Port 01028fe7-7644-4a03-bb34-6762d2043774 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=01028fe7-7644-4a03-bb34-6762d2043774,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=01028fe7-7644-4a03-bb34-6762d2043774,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:13.966203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a0f21133-526d-443e-bdca-f8a461812577 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (01028fe7-7644-4a03-bb34-6762d2043774), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:14.460176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a0f21133-526d-443e-bdca-f8a461812577 service neutron] Resource Port 01028fe7-7644-4a03-bb34-6762d2043774 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=01028fe7-7644-4a03-bb34-6762d2043774,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=01028fe7-7644-4a03-bb34-6762d2043774,segment=NetworkSegment(a2b144b3-1489-4a11-bdb8-6be66ef8e43c),segment_id=a2b144b3-1489-4a11-bdb8-6be66ef8e43c)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=01028fe7-7644-4a03-bb34-6762d2043774,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:14.460901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a0f21133-526d-443e-bdca-f8a461812577 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (01028fe7-7644-4a03-bb34-6762d2043774), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:14.747830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:14.748999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:15.297297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:414 started Oct 16 01:03:15.303540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416efe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=943000000,duration_sec=861,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:15.305651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:15.306339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:414 - starting polling. Elapsed:0.009 Oct 16 01:03:15.330114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:15.340056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:414 - port information retrieved. Elapsed:0.043 Oct 16 01:03:15.340552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.044 Oct 16 01:03:16.131077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e87fd71d-fbbc-4b16-9831-cf4015897161 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:15Z,data_plane_status=None,description='',device_id='391edabf-85a9-4565-92f6-ebd0664d3e20',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ea701c3f-eb65-4a82-83d0-b757b0f39524,mac_address=fa:16:3e:59:7e:1a,name='',network_id=67400858-429f-4052-a9a5-3012690406d5,numa_affinity_policy=,project_id='cb1743385ea14cc39244c83e8fc88e7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ea701c3f-eb65-4a82-83d0-b757b0f39524),security_group_ids=set([04a6f405-fb32-4245-a68e-14ecec65861c]),status='DOWN',updated_at=2022-10-16T01:03:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:16.131855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e87fd71d-fbbc-4b16-9831-cf4015897161 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ea701c3f-eb65-4a82-83d0-b757b0f39524), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:16.134189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e87fd71d-fbbc-4b16-9831-cf4015897161 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group member updated {'04a6f405-fb32-4245-a68e-14ecec65861c'} Oct 16 01:03:17.298739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:415 started Oct 16 01:03:17.302327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f00,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=945000000,duration_sec=863,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:17.304175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:17.305306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:415 - starting polling. Elapsed:0.006 Oct 16 01:03:17.310951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:17.317300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:415 - port information retrieved. Elapsed:0.019 Oct 16 01:03:17.317839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Oct 16 01:03:17.585032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db1b604f-40af-4ba3-ac0d-03bb5f5c50c5 service neutron] Resource Port ea701c3f-eb65-4a82-83d0-b757b0f39524 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=ea701c3f-eb65-4a82-83d0-b757b0f39524,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ea701c3f-eb65-4a82-83d0-b757b0f39524,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:17.585610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db1b604f-40af-4ba3-ac0d-03bb5f5c50c5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ea701c3f-eb65-4a82-83d0-b757b0f39524), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:18.543241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db1b604f-40af-4ba3-ac0d-03bb5f5c50c5 service neutron] Resource Port ea701c3f-eb65-4a82-83d0-b757b0f39524 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ea701c3f-eb65-4a82-83d0-b757b0f39524,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=ea701c3f-eb65-4a82-83d0-b757b0f39524,segment=NetworkSegment(e85c3ee2-f8b6-42c0-8def-930e36cc19ac),segment_id=e85c3ee2-f8b6-42c0-8def-930e36cc19ac)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ea701c3f-eb65-4a82-83d0-b757b0f39524,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:18.543850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db1b604f-40af-4ba3-ac0d-03bb5f5c50c5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ea701c3f-eb65-4a82-83d0-b757b0f39524), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:18.754552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 01028fe7-7644-4a03-bb34-6762d2043774 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:18.755326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (01028fe7-7644-4a03-bb34-6762d2043774), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:19.300603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:416 started Oct 16 01:03:19.309947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f02,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=948000000,duration_sec=865,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:19.310641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:19.311910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:416 - starting polling. Elapsed:0.011 Oct 16 01:03:19.316684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:19.326882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:416 - port information retrieved. Elapsed:0.027 Oct 16 01:03:19.327573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Oct 16 01:03:20.577268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 01028fe7-7644-4a03-bb34-6762d2043774 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:20.578446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (01028fe7-7644-4a03-bb34-6762d2043774), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:21.301962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:417 started Oct 16 01:03:21.304761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f04,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=947000000,duration_sec=867,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:21.305390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:21.305727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:417 - starting polling. Elapsed:0.004 Oct 16 01:03:21.314458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:21.328181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:417 - port information retrieved. Elapsed:0.026 Oct 16 01:03:21.328734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Oct 16 01:03:23.303574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:418 started Oct 16 01:03:23.315881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f06,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=951000000,duration_sec=869,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:23.317942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:23.318800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 01:03:25.306160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:419 started Oct 16 01:03:25.312531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f08,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=953000000,duration_sec=871,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:25.313611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:25.314090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:03:26.565972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port ea701c3f-eb65-4a82-83d0-b757b0f39524 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:26.566671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ea701c3f-eb65-4a82-83d0-b757b0f39524), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:27.306783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:420 started Oct 16 01:03:27.311477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f0a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=953000000,duration_sec=873,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:27.312479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:27.313091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:420 - starting polling. Elapsed:0.006 Oct 16 01:03:27.319742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:27.329984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:420 - port information retrieved. Elapsed:0.023 Oct 16 01:03:27.330573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Oct 16 01:03:28.762073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port ea701c3f-eb65-4a82-83d0-b757b0f39524 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:28.763081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (ea701c3f-eb65-4a82-83d0-b757b0f39524), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:28.899910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:28.900289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:29.307898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:421 started Oct 16 01:03:29.311211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f0c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=953000000,duration_sec=875,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:29.311953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:29.312716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:421 - starting polling. Elapsed:0.005 Oct 16 01:03:29.320346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:29.331976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:421 - port information retrieved. Elapsed:0.024 Oct 16 01:03:29.332555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.025 Oct 16 01:03:31.308731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:422 started Oct 16 01:03:31.311310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f0e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=954000000,duration_sec=877,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:31.312020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:31.312274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:03:32.662628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcb8e790-6fbe-428a-842c-5a801bc25937 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:03:32Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6923da62-5c1b-4339-9ea8-d2c3c6c29548,mac_address=fa:16:3e:38:80:6e,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6923da62-5c1b-4339-9ea8-d2c3c6c29548),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:03:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:32.663974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcb8e790-6fbe-428a-842c-5a801bc25937 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6923da62-5c1b-4339-9ea8-d2c3c6c29548), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:33.309357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:423 started Oct 16 01:03:33.311838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f10,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=955000000,duration_sec=879,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:33.312428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:33.312766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:423 - starting polling. Elapsed:0.004 Oct 16 01:03:33.316446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:33.322779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:423 - port information retrieved. Elapsed:0.013 Oct 16 01:03:33.323163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:03:33.369483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bcb8e790-6fbe-428a-842c-5a801bc25937 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port 6923da62-5c1b-4339-9ea8-d2c3c6c29548 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a72ef8fd-0f8c-4ded-b359-d0e905028371'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:33.370172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bcb8e790-6fbe-428a-842c-5a801bc25937 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (6923da62-5c1b-4339-9ea8-d2c3c6c29548), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:34.499345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d7329e11-1cde-44c9-a087-af983103b945 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:34.499972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d7329e11-1cde-44c9-a087-af983103b945 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (55fcc1bb-db7a-478d-a43e-2302d6cbccc8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:34.500137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d7329e11-1cde-44c9-a087-af983103b945 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group member updated {'47131bbf-f06f-4a48-870c-42726cd628dd'} Oct 16 01:03:35.310440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:424 started Oct 16 01:03:35.313287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f12,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=956000000,duration_sec=881,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:35.313878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:35.314220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:424 - starting polling. Elapsed:0.004 Oct 16 01:03:35.317929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:35.328575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 not present in bridge br-int Oct 16 01:03:35.329255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:35.329714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['55fcc1bb-db7a-478d-a43e-2302d6cbccc8'] Oct 16 01:03:35.330201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 55fcc1bb-db7a-478d-a43e-2302d6cbccc8 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:35.344215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:424 - port information retrieved. Elapsed:0.034 Oct 16 01:03:35.344869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.034 Oct 16 01:03:37.207496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroup deleted: 47131bbf-f06f-4a48-870c-42726cd628dd {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:37.208606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (47131bbf-f06f-4a48-870c-42726cd628dd), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:37.209083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('47131bbf-f06f-4a48-870c-42726cd628dd',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:37.228927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('47131bbf-f06f-4a48-870c-42726cd628dd',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:37.229525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 4c4f225f-c00e-40e7-9957-537238b2be0b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:37.229898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4c4f225f-c00e-40e7-9957-537238b2be0b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:37.230237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:03:37.230686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: cacf7c69-3f28-4154-9453-77d1dba4b5cc {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:37.231086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (cacf7c69-3f28-4154-9453-77d1dba4b5cc), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:37.231566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:03:37.231954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: dc40ae9f-c6b9-453c-bbc0-7decd186cc40 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:37.232389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dc40ae9f-c6b9-453c-bbc0-7decd186cc40), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:37.232764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:03:37.233311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource SecurityGroupRule deleted: 569ad5c8-4430-43b8-aa82-e8d7f6f36493 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:37.233711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (569ad5c8-4430-43b8-aa82-e8d7f6f36493), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:37.234090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8682d505-9e65-4db7-8bc5-f12f67d7a29c tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Security group rule updated ['47131bbf-f06f-4a48-870c-42726cd628dd'] Oct 16 01:03:37.311891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:425 started Oct 16 01:03:37.319376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f14,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=958000000,duration_sec=883,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:37.320335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:37.320691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:03:37.882793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c5369cc-c5bf-400e-a8a6-10e0f8fd1112 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Resource Port deleted: 2124aac1-2814-4b0a-bc61-9375ec62d794 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:37.884391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c5369cc-c5bf-400e-a8a6-10e0f8fd1112 tempest-AttachVolumeNegativeTest-428578509 tempest-AttachVolumeNegativeTest-428578509-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (2124aac1-2814-4b0a-bc61-9375ec62d794), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:39.313304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:426 started Oct 16 01:03:39.316323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f16,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=959000000,duration_sec=885,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:39.318949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:39.318949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:426 - starting polling. Elapsed:0.004 Oct 16 01:03:39.324402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:39.327803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 2124aac1-2814-4b0a-bc61-9375ec62d794 not present in bridge br-int Oct 16 01:03:39.328368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:39.328846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['2124aac1-2814-4b0a-bc61-9375ec62d794'] Oct 16 01:03:39.329366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 2124aac1-2814-4b0a-bc61-9375ec62d794 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:39.336066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:426 - port information retrieved. Elapsed:0.023 Oct 16 01:03:39.336659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Oct 16 01:03:40.567168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:40.567943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:41.314010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:427 started Oct 16 01:03:41.316695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f18,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=959000000,duration_sec=887,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:41.317443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:41.317998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:427 - starting polling. Elapsed:0.004 Oct 16 01:03:41.323178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:41.329971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:427 - port information retrieved. Elapsed:0.016 Oct 16 01:03:41.330325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 16 01:03:42.869772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-70a8ffc1-75b6-4027-a7dd-42a0a7b65172 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource Port c570709d-29cc-4c4f-a39b-9bfd4da608ed updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'ef62311a-4a30-42aa-bd68-cc2deadeb13a', '55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'})} New fields: {'security_group_ids': CoercedSet({'55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'})} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:42.870772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-70a8ffc1-75b6-4027-a7dd-42a0a7b65172 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:42.871279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-70a8ffc1-75b6-4027-a7dd-42a0a7b65172 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group member updated {'ef62311a-4a30-42aa-bd68-cc2deadeb13a', '55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'} Oct 16 01:03:43.314776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:428 started Oct 16 01:03:43.322878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f1a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=961000000,duration_sec=889,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:43.325128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:43.325733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:428 - starting polling. Elapsed:0.011 Oct 16 01:03:43.329740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.336073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:428 - port information retrieved. Elapsed:0.021 Oct 16 01:03:43.336428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Oct 16 01:03:43.337733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroup deleted: ef62311a-4a30-42aa-bd68-cc2deadeb13a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.338106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (ef62311a-4a30-42aa-bd68-cc2deadeb13a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.338618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ef62311a-4a30-42aa-bd68-cc2deadeb13a',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:43.361488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ef62311a-4a30-42aa-bd68-cc2deadeb13a',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:43.362052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: 1111aa19-d114-467a-a09c-191d14379bbb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.362435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1111aa19-d114-467a-a09c-191d14379bbb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.362826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.363266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: a60db376-071c-489f-8598-fdef7f31b2f2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.363620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a60db376-071c-489f-8598-fdef7f31b2f2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.364005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.364387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: 6b76ae23-18e2-411e-ba1f-7be265209579 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.364740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6b76ae23-18e2-411e-ba1f-7be265209579), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.365065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.365527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: 60853c63-505f-430b-93d3-fc2137987257 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.367039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (60853c63-505f-430b-93d3-fc2137987257), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.367372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.368041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: baa16170-e29a-4541-aa20-fcfecf4ce86b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.368465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (baa16170-e29a-4541-aa20-fcfecf4ce86b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.369020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.369400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: 25dc17ef-227d-44c3-9b47-bfcdcc249ea6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.369748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (25dc17ef-227d-44c3-9b47-bfcdcc249ea6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.370076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.370452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: 30a67a71-f8fd-42ca-a402-6d3af81327f6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.370797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (30a67a71-f8fd-42ca-a402-6d3af81327f6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.371146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.371520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource SecurityGroupRule deleted: 98475baf-fda3-428a-bec4-c23ab3faf91e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.371914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (98475baf-fda3-428a-bec4-c23ab3faf91e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.372379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4c58a05c-ac00-4793-8fba-43042088ed2c tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group rule updated ['ef62311a-4a30-42aa-bd68-cc2deadeb13a'] Oct 16 01:03:43.652889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-058b6051-cddd-4a7b-81b6-7f932e19ca66 admin admin] Resource Port deleted: 1243eb6a-8f6b-4732-b89b-091ec46b2b6d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.654400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-058b6051-cddd-4a7b-81b6-7f932e19ca66 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (1243eb6a-8f6b-4732-b89b-091ec46b2b6d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:43.886002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77013a27-ef41-4e75-90e3-4916c96946c1 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource Port deleted: 87e7e566-7b39-4933-8e8c-8d7ac54f0dd7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:43.886719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77013a27-ef41-4e75-90e3-4916c96946c1 tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (87e7e566-7b39-4933-8e8c-8d7ac54f0dd7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:45.316224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:429 started Oct 16 01:03:45.320888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f1c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=963000000,duration_sec=891,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:45.322383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:45.323014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:429 - starting polling. Elapsed:0.007 Oct 16 01:03:45.327665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:45.333430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 87e7e566-7b39-4933-8e8c-8d7ac54f0dd7 not present in bridge br-int Oct 16 01:03:45.333799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:45.354033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1243eb6a-8f, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:03:45.371513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f1e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:45.372717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '87e7e566-7b39-4933-8e8c-8d7ac54f0dd7'] Oct 16 01:03:45.374950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 87e7e566-7b39-4933-8e8c-8d7ac54f0dd7 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:45.375330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:45.463926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567e9a0-14a8-4b23-bae9-b8c27b367a92]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:45.469765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:429 - port information retrieved. Elapsed:0.154 Oct 16 01:03:45.470373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.154 Oct 16 01:03:45.815446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4bb07573-05a3-4cb1-beb4-5799351fb3f5","delete","qr-1243eb6a-8f",14,["map",[["attached-mac","fa:16:3e:27:e4:1b"],["iface-id","1243eb6a-8f6b-4732-b89b-091ec46b2b6d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:46.104931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-010455ab-7ab3-4d6e-95d6-233404f7eb4c admin admin] Resource Port deleted: a74fd78f-a45f-4321-a4ca-57d2bcba43d1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:46.105441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-010455ab-7ab3-4d6e-95d6-233404f7eb4c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (a74fd78f-a45f-4321-a4ca-57d2bcba43d1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:46.333265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["66872696-ce37-4e88-aea1-931fa1360082","delete","qg-a74fd78f-a4",15,["map",[["attached-mac","fa:16:3e:c8:27:1d"],["iface-id","a74fd78f-a45f-4321-a4ca-57d2bcba43d1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:46.800836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f85efec-dc34-44de-a706-8b125d6499fd admin admin] Resource Subnet deleted: a617817b-7e5e-42c9-b510-1f81c28bf50c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:46.801302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2f85efec-dc34-44de-a706-8b125d6499fd admin admin] Publish callbacks [] for Subnet (a617817b-7e5e-42c9-b510-1f81c28bf50c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:46.948097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4d358ad0-52a0-4a4f-945d-cdc33e6b25f9","delete","tap69a1bb27-22",8,["map",[["attached-mac","fa:16:3e:1f:8a:c2"],["iface-id","69a1bb27-221a-4f64-b9b2-e02c1194c2d4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:47.269193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9646e45d-6711-436e-8053-c423bbc7cb3d None None] Resource Port deleted: 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:47.270482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9646e45d-6711-436e-8053-c423bbc7cb3d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (69a1bb27-221a-4f64-b9b2-e02c1194c2d4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:47.317671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:430 started Oct 16 01:03:47.320807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f20,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=964000000,duration_sec=893,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:47.321425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:47.321928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:430 - starting polling. Elapsed:0.004 Oct 16 01:03:47.325776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:47.333507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f22,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:47.336328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f24,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:47.338667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f26,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:47.338822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:430 - port information retrieved. Elapsed:0.021 Oct 16 01:03:47.339281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '58159a88-5783-4e48-abef-6853eb73d938', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:47.339491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:430 - agent port security group processed in 0.000 Oct 16 01:03:47.342595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:03:47.342936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4'} Oct 16 01:03:47.343335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1243eb6a-8f6b-4732-b89b-091ec46b2b6d is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:47.343917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:47.385175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b54faf1-24e6-467a-a1b8-3d568a0b2e1a]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:47.385985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'a74fd78f-a45f-4321-a4ca-57d2bcba43d1', '1243eb6a-8f6b-4732-b89b-091ec46b2b6d', '69a1bb27-221a-4f64-b9b2-e02c1194c2d4'} removed Oct 16 01:03:47.478035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:03:47.478574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:47.479053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 6 from net-id = 7dae3d76-90a2-41d2-9dad-7f7856d5ab85, seg-id = 354 Oct 16 01:03:47.481688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8c9d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:47.484650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416f28,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4450}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:47.484987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:430 - treat_devices_removed completed in 0.142 Oct 16 01:03:47.485293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:430 - ports processed. Elapsed:0.168 Oct 16 01:03:47.485636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.168 Oct 16 01:03:47.500448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36a7c951-5105-4861-ba1e-cd25d66f80d3 admin admin] Resource Port deleted: 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:47.500792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36a7c951-5105-4861-ba1e-cd25d66f80d3 admin admin] Skipped duplicate delete event for 69a1bb27-221a-4f64-b9b2-e02c1194c2d4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 01:03:47.786555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-36a7c951-5105-4861-ba1e-cd25d66f80d3 admin admin] Resource Network deleted: 7dae3d76-90a2-41d2-9dad-7f7856d5ab85 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:47.787037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-36a7c951-5105-4861-ba1e-cd25d66f80d3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (7dae3d76-90a2-41d2-9dad-7f7856d5ab85), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:48.068862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Resource SecurityGroup deleted: bfc3cec1-1713-4e74-91f5-897a956f6102 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:48.069491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (bfc3cec1-1713-4e74-91f5-897a956f6102), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:48.070027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bfc3cec1-1713-4e74-91f5-897a956f6102',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:48.083205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bfc3cec1-1713-4e74-91f5-897a956f6102',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:48.083752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Resource SecurityGroupRule deleted: 1c20afe0-ea9a-40ba-88e3-d6379d8a25d5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:48.084622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1c20afe0-ea9a-40ba-88e3-d6379d8a25d5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:48.085026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 01:03:48.085797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Resource SecurityGroupRule deleted: 2babb8ce-7da9-40ec-92e1-aa15b3a60621 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:48.086165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2babb8ce-7da9-40ec-92e1-aa15b3a60621), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:48.086496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 01:03:48.087091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Resource SecurityGroupRule deleted: eba8635f-f373-4496-a102-777f1231fd6d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:48.087465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (eba8635f-f373-4496-a102-777f1231fd6d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:48.087790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 01:03:48.088169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Resource SecurityGroupRule deleted: f43f9ba4-a380-4133-9181-caa3a148e1eb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:48.088539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f43f9ba4-a380-4133-9181-caa3a148e1eb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:48.088865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5aee2dcb-7297-4b3f-8f0f-e86198243727 admin admin] Security group rule updated ['bfc3cec1-1713-4e74-91f5-897a956f6102'] Oct 16 01:03:48.686375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:48.689551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:49.319165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:431 started Oct 16 01:03:49.322598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f2a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=965000000,duration_sec=895,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:49.323247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:49.323593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:431 - starting polling. Elapsed:0.005 Oct 16 01:03:49.327749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:49.332412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:431 - port information retrieved. Elapsed:0.014 Oct 16 01:03:49.332761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:03:50.624869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:03:50.626297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:51.320461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:432 started Oct 16 01:03:51.323958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f2c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=966000000,duration_sec=897,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:51.325202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:51.325882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:432 - starting polling. Elapsed:0.006 Oct 16 01:03:51.329542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:51.334319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:432 - port information retrieved. Elapsed:0.014 Oct 16 01:03:51.334662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:03:53.310099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:03:53Z,description='Default security group',id=11908387-de45-464f-9de6-54095061c7c1,is_default=True,name='default',project_id='30ceb8cab7454065b963967e35dde6e2',revision_number=1,rules=[SecurityGroupRule(011e0b15-9bf5-483f-bb9d-6cdcb6033fdf),SecurityGroupRule(8825316a-37c7-48e6-a41b-15fabcba6430),SecurityGroupRule(d7d5dcb5-5a3e-467d-a3f5-65014cdd84e4),SecurityGroupRule(fdb5e285-c286-42b0-ae5b-4d98f6fa9f0c)],shared=False,stateful=True,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:53.310761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (11908387-de45-464f-9de6-54095061c7c1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.311243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='ingress',ethertype='IPv4',id=011e0b15-9bf5-483f-bb9d-6cdcb6033fdf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30ceb8cab7454065b963967e35dde6e2',protocol=,remote_address_group_id=,remote_group_id=11908387-de45-464f-9de6-54095061c7c1,remote_ip_prefix=,revision_number=0,security_group_id=11908387-de45-464f-9de6-54095061c7c1,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:53.311953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (011e0b15-9bf5-483f-bb9d-6cdcb6033fdf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.311953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.312625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='ingress',ethertype='IPv6',id=8825316a-37c7-48e6-a41b-15fabcba6430,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30ceb8cab7454065b963967e35dde6e2',protocol=,remote_address_group_id=,remote_group_id=11908387-de45-464f-9de6-54095061c7c1,remote_ip_prefix=,revision_number=0,security_group_id=11908387-de45-464f-9de6-54095061c7c1,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:53.312985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8825316a-37c7-48e6-a41b-15fabcba6430), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.313317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.314855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='egress',ethertype='IPv4',id=d7d5dcb5-5a3e-467d-a3f5-65014cdd84e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30ceb8cab7454065b963967e35dde6e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=11908387-de45-464f-9de6-54095061c7c1,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:53.314855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d7d5dcb5-5a3e-467d-a3f5-65014cdd84e4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.314855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.315445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='egress',ethertype='IPv6',id=fdb5e285-c286-42b0-ae5b-4d98f6fa9f0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='30ceb8cab7454065b963967e35dde6e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=11908387-de45-464f-9de6-54095061c7c1,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:53.315984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fdb5e285-c286-42b0-ae5b-4d98f6fa9f0c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.316490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e1eab193-5935-4135-994c-c30922481549 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.321506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:433 started Oct 16 01:03:53.325862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=967000000,duration_sec=899,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:53.326652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:53.327228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 01:03:53.510587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Resource SecurityGroup deleted: 11908387-de45-464f-9de6-54095061c7c1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:53.511005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (11908387-de45-464f-9de6-54095061c7c1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.511471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('11908387-de45-464f-9de6-54095061c7c1',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:53.527100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('11908387-de45-464f-9de6-54095061c7c1',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:53.527818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Resource SecurityGroupRule deleted: 011e0b15-9bf5-483f-bb9d-6cdcb6033fdf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:53.528395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (011e0b15-9bf5-483f-bb9d-6cdcb6033fdf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.529093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.529610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Resource SecurityGroupRule deleted: 8825316a-37c7-48e6-a41b-15fabcba6430 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:53.530218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8825316a-37c7-48e6-a41b-15fabcba6430), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.530706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.531276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Resource SecurityGroupRule deleted: d7d5dcb5-5a3e-467d-a3f5-65014cdd84e4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:53.531634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d7d5dcb5-5a3e-467d-a3f5-65014cdd84e4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.531964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:53.532347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Resource SecurityGroupRule deleted: fdb5e285-c286-42b0-ae5b-4d98f6fa9f0c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:53.532724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fdb5e285-c286-42b0-ae5b-4d98f6fa9f0c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:53.533051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2bcb943c-28a4-4337-a3ea-8239a5e212e0 admin admin] Security group rule updated ['11908387-de45-464f-9de6-54095061c7c1'] Oct 16 01:03:54.011061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:03:53Z,description='Default security group',id=df67c201-4162-4144-b90c-a91f81b892b0,is_default=True,name='default',project_id='d65efccc51b242328695e268c0200498',revision_number=1,rules=[SecurityGroupRule(40739d69-226e-4329-a72f-2be03df4f1d8),SecurityGroupRule(8a16eaf3-8c7e-4eff-a263-8c33f906d36e),SecurityGroupRule(c580b790-3ee5-4f88-9d7c-c6917f8ca957),SecurityGroupRule(e7e65f91-ed92-43ce-a481-a033881fa4e7)],shared=False,stateful=True,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:54.011524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (df67c201-4162-4144-b90c-a91f81b892b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.012400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='ingress',ethertype='IPv6',id=40739d69-226e-4329-a72f-2be03df4f1d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d65efccc51b242328695e268c0200498',protocol=,remote_address_group_id=,remote_group_id=df67c201-4162-4144-b90c-a91f81b892b0,remote_ip_prefix=,revision_number=0,security_group_id=df67c201-4162-4144-b90c-a91f81b892b0,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:54.013059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (40739d69-226e-4329-a72f-2be03df4f1d8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.013385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.014756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='egress',ethertype='IPv4',id=8a16eaf3-8c7e-4eff-a263-8c33f906d36e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d65efccc51b242328695e268c0200498',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=df67c201-4162-4144-b90c-a91f81b892b0,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:54.015223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8a16eaf3-8c7e-4eff-a263-8c33f906d36e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.016185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.016877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='egress',ethertype='IPv6',id=c580b790-3ee5-4f88-9d7c-c6917f8ca957,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d65efccc51b242328695e268c0200498',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=df67c201-4162-4144-b90c-a91f81b892b0,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:54.019399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c580b790-3ee5-4f88-9d7c-c6917f8ca957), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.019773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.020486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:53Z,description=,direction='ingress',ethertype='IPv4',id=e7e65f91-ed92-43ce-a481-a033881fa4e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d65efccc51b242328695e268c0200498',protocol=,remote_address_group_id=,remote_group_id=df67c201-4162-4144-b90c-a91f81b892b0,remote_ip_prefix=,revision_number=0,security_group_id=df67c201-4162-4144-b90c-a91f81b892b0,updated_at=2022-10-16T01:03:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:54.020858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e7e65f91-ed92-43ce-a481-a033881fa4e7), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.021224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-846f2818-a49e-47bc-96cb-5fc775f3bab1 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.033968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bb0511c0-639f-46e8-8ebf-4db928ec1a2f tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Resource Port deleted: c570709d-29cc-4c4f-a39b-9bfd4da608ed {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:54.034900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bb0511c0-639f-46e8-8ebf-4db928ec1a2f tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (c570709d-29cc-4c4f-a39b-9bfd4da608ed), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.036237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bb0511c0-639f-46e8-8ebf-4db928ec1a2f tempest-TestMinimumBasicScenario-1525636228 tempest-TestMinimumBasicScenario-1525636228-project] Security group member updated {'55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'} Oct 16 01:03:54.182289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Resource SecurityGroup deleted: df67c201-4162-4144-b90c-a91f81b892b0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:54.182825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (df67c201-4162-4144-b90c-a91f81b892b0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.183163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('df67c201-4162-4144-b90c-a91f81b892b0',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:54.199450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('df67c201-4162-4144-b90c-a91f81b892b0',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:54.200115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Resource SecurityGroupRule deleted: 40739d69-226e-4329-a72f-2be03df4f1d8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:54.200652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (40739d69-226e-4329-a72f-2be03df4f1d8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.201193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.201653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Resource SecurityGroupRule deleted: 8a16eaf3-8c7e-4eff-a263-8c33f906d36e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:54.202086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8a16eaf3-8c7e-4eff-a263-8c33f906d36e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.202474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.202938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Resource SecurityGroupRule deleted: c580b790-3ee5-4f88-9d7c-c6917f8ca957 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:54.203344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c580b790-3ee5-4f88-9d7c-c6917f8ca957), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.203726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:54.204157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Resource SecurityGroupRule deleted: e7e65f91-ed92-43ce-a481-a033881fa4e7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:54.204563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e7e65f91-ed92-43ce-a481-a033881fa4e7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:54.204982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-879711b1-1f1d-42b6-9a55-866b24c1df41 admin admin] Security group rule updated ['df67c201-4162-4144-b90c-a91f81b892b0'] Oct 16 01:03:55.322992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:434 started Oct 16 01:03:55.326061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=968000000,duration_sec=901,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:55.326855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:55.327232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:434 - starting polling. Elapsed:0.004 Oct 16 01:03:55.330422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:55.332792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port c570709d-29cc-4c4f-a39b-9bfd4da608ed not present in bridge br-int Oct 16 01:03:55.333450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:03:55.334483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['c570709d-29cc-4c4f-a39b-9bfd4da608ed'] Oct 16 01:03:55.335157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port c570709d-29cc-4c4f-a39b-9bfd4da608ed is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:03:55.340388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:434 - port information retrieved. Elapsed:0.018 Oct 16 01:03:55.340760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Oct 16 01:03:57.318985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:03:57Z,description='Default security group',id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,is_default=True,name='default',project_id='0a5be2f1df3f4739964817caa21ea82f',revision_number=1,rules=[SecurityGroupRule(4c01ada6-50f3-4600-93c5-1ce98b4f8312),SecurityGroupRule(575b9ceb-3bee-4fd8-9e33-2d529806587b),SecurityGroupRule(922e8c04-e130-4680-880d-ffc8fba238e2),SecurityGroupRule(94e04177-e42c-4088-b1a0-4a255969ecab)],shared=False,stateful=True,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:57.319648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.320007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='egress',ethertype='IPv6',id=4c01ada6-50f3-4600-93c5-1ce98b4f8312,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a5be2f1df3f4739964817caa21ea82f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:57.320365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4c01ada6-50f3-4600-93c5-1ce98b4f8312), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.320701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.321382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='ingress',ethertype='IPv6',id=575b9ceb-3bee-4fd8-9e33-2d529806587b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a5be2f1df3f4739964817caa21ea82f',protocol=,remote_address_group_id=,remote_group_id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,remote_ip_prefix=,revision_number=0,security_group_id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:57.321726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (575b9ceb-3bee-4fd8-9e33-2d529806587b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.322301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.322985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='ingress',ethertype='IPv4',id=922e8c04-e130-4680-880d-ffc8fba238e2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a5be2f1df3f4739964817caa21ea82f',protocol=,remote_address_group_id=,remote_group_id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,remote_ip_prefix=,revision_number=0,security_group_id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:57.323338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (922e8c04-e130-4680-880d-ffc8fba238e2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.323660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.324364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='egress',ethertype='IPv4',id=94e04177-e42c-4088-b1a0-4a255969ecab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a5be2f1df3f4739964817caa21ea82f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:57.324741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (94e04177-e42c-4088-b1a0-4a255969ecab), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.325081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-06ba63f8-86fa-42cf-9d32-44af570cb764 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.326021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:435 started Oct 16 01:03:57.329173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=971000000,duration_sec=903,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:57.329743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:57.330295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:03:57.407430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7285dd9e-0a44-4703-bc6e-1cb07b30c295 admin admin] Resource Port deleted: 7d0732f2-b77d-4ee1-a9e9-7bf8e7736171 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:57.408339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7285dd9e-0a44-4703-bc6e-1cb07b30c295 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (7d0732f2-b77d-4ee1-a9e9-7bf8e7736171), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.482969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Resource SecurityGroup deleted: 734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:57.483366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.483836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:57.501472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:57.502037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Resource SecurityGroupRule deleted: 4c01ada6-50f3-4600-93c5-1ce98b4f8312 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:57.502442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4c01ada6-50f3-4600-93c5-1ce98b4f8312), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.502785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.504068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Resource SecurityGroupRule deleted: 575b9ceb-3bee-4fd8-9e33-2d529806587b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:57.504437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (575b9ceb-3bee-4fd8-9e33-2d529806587b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.504769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.505151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Resource SecurityGroupRule deleted: 922e8c04-e130-4680-880d-ffc8fba238e2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:57.505734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (922e8c04-e130-4680-880d-ffc8fba238e2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.506064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:57.506441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Resource SecurityGroupRule deleted: 94e04177-e42c-4088-b1a0-4a255969ecab {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:57.506791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (94e04177-e42c-4088-b1a0-4a255969ecab), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:57.512040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5a39cb50-722a-4032-8902-4f2413279eb0 admin admin] Security group rule updated ['734bebc5-1c3d-47bd-96c0-3b3d42bb4bd2'] Oct 16 01:03:58.110596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:03:57Z,description='Default security group',id=26ccd175-ee88-4e04-a42c-685f45cdca8e,is_default=True,name='default',project_id='3cff058f536f4a10ab740d7f2faf599d',revision_number=1,rules=[SecurityGroupRule(453de4f6-2ced-4f0b-a911-c997beef87ab),SecurityGroupRule(7b64366a-5f2b-4ef0-83f1-e0c0839419de),SecurityGroupRule(bc1cd859-dcb0-4f0d-b597-bbfe83420aa0),SecurityGroupRule(dc529378-d245-4185-ae64-6e127ee52c28)],shared=False,stateful=True,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:58.113012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (26ccd175-ee88-4e04-a42c-685f45cdca8e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.115993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='ingress',ethertype='IPv4',id=453de4f6-2ced-4f0b-a911-c997beef87ab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cff058f536f4a10ab740d7f2faf599d',protocol=,remote_address_group_id=,remote_group_id=26ccd175-ee88-4e04-a42c-685f45cdca8e,remote_ip_prefix=,revision_number=0,security_group_id=26ccd175-ee88-4e04-a42c-685f45cdca8e,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:58.116584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (453de4f6-2ced-4f0b-a911-c997beef87ab), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.117122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.118086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='egress',ethertype='IPv6',id=7b64366a-5f2b-4ef0-83f1-e0c0839419de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cff058f536f4a10ab740d7f2faf599d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=26ccd175-ee88-4e04-a42c-685f45cdca8e,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:58.118642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7b64366a-5f2b-4ef0-83f1-e0c0839419de), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.119164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.120131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='egress',ethertype='IPv4',id=bc1cd859-dcb0-4f0d-b597-bbfe83420aa0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cff058f536f4a10ab740d7f2faf599d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=26ccd175-ee88-4e04-a42c-685f45cdca8e,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:58.120851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bc1cd859-dcb0-4f0d-b597-bbfe83420aa0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.121469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.122298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:03:57Z,description=,direction='ingress',ethertype='IPv6',id=dc529378-d245-4185-ae64-6e127ee52c28,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3cff058f536f4a10ab740d7f2faf599d',protocol=,remote_address_group_id=,remote_group_id=26ccd175-ee88-4e04-a42c-685f45cdca8e,remote_ip_prefix=,revision_number=0,security_group_id=26ccd175-ee88-4e04-a42c-685f45cdca8e,updated_at=2022-10-16T01:03:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:03:58.122831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dc529378-d245-4185-ae64-6e127ee52c28), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.123368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-667c0429-4ca4-48f2-9807-f6235d8d0890 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.287431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Resource SecurityGroup deleted: 26ccd175-ee88-4e04-a42c-685f45cdca8e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:58.287863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (26ccd175-ee88-4e04-a42c-685f45cdca8e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.288335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('26ccd175-ee88-4e04-a42c-685f45cdca8e',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:03:58.301991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('26ccd175-ee88-4e04-a42c-685f45cdca8e',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:03:58.304342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Resource SecurityGroupRule deleted: 453de4f6-2ced-4f0b-a911-c997beef87ab {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:58.304741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (453de4f6-2ced-4f0b-a911-c997beef87ab), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.305097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.305522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Resource SecurityGroupRule deleted: 7b64366a-5f2b-4ef0-83f1-e0c0839419de {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:58.305887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7b64366a-5f2b-4ef0-83f1-e0c0839419de), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.306227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.306614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Resource SecurityGroupRule deleted: bc1cd859-dcb0-4f0d-b597-bbfe83420aa0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:58.306998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bc1cd859-dcb0-4f0d-b597-bbfe83420aa0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.307336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.307718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Resource SecurityGroupRule deleted: dc529378-d245-4185-ae64-6e127ee52c28 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:58.308077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dc529378-d245-4185-ae64-6e127ee52c28), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.308403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8166b361-b5ac-469a-80f3-8fbe875b6736 admin admin] Security group rule updated ['26ccd175-ee88-4e04-a42c-685f45cdca8e'] Oct 16 01:03:58.811381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a1fcf169-1980-4aaf-ac40-4b9bf437a807 admin admin] Resource Port deleted: 9c8df3fc-5ba4-4d5b-a201-b5269c461008 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:58.823544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a1fcf169-1980-4aaf-ac40-4b9bf437a807 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (9c8df3fc-5ba4-4d5b-a201-b5269c461008), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:58.850981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bcbfe645-25e2-4a6d-843f-91b050552e89","delete","qr-7d0732f2-b7",32,["map",[["attached-mac","fa:16:3e:05:1c:6f"],["iface-id","7d0732f2-b77d-4ee1-a9e9-7bf8e7736171"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:59.269138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9ec50932-3491-4f1c-9ab0-7f03cc31fb38","delete","qg-9c8df3fc-5b",31,["map",[["attached-mac","fa:16:3e:2f:57:97"],["iface-id","9c8df3fc-5ba4-4d5b-a201-b5269c461008"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:59.302817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-788ac40d-ebd9-4661-9bec-42479b090c7c admin admin] Resource Subnet deleted: 9efd72bb-10d0-4ec3-88df-b489c0a0e472 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:59.302817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-788ac40d-ebd9-4661-9bec-42479b090c7c admin admin] Publish callbacks [] for Subnet (9efd72bb-10d0-4ec3-88df-b489c0a0e472), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:59.328960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:436 started Oct 16 01:03:59.461302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["778393bd-a1fe-4404-90dc-0c5ca06c13a9","delete","tap4be31983-76",30,["map",[["attached-mac","fa:16:3e:43:11:9a"],["iface-id","4be31983-76fd-4267-b2a1-c5cf8c2a29ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:03:59.563866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=205000000,duration_sec=906,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:59.564257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:03:59.564764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:436 - starting polling. Elapsed:0.236 Oct 16 01:03:59.568499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:59.593122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f36,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:59.598666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f38,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:59.607849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f3a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:59.608262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:436 - port information retrieved. Elapsed:0.279 Oct 16 01:03:59.608554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', '5a7f9645-4a05-4db1-b67e-c1272d395572', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', '73b1010c-4f64-4e77-9033-9c0c75eb24b8', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'd85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:03:59.610339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:436 - agent port security group processed in 0.000 Oct 16 01:03:59.619941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:03:59.620222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba'} Oct 16 01:03:59.620910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 12 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:03:59.674805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7cbc2a0-1ae8-427b-bb5a-a628af646d4c admin admin] Resource Port deleted: 4be31983-76fd-4267-b2a1-c5cf8c2a29ba {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:59.675284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7cbc2a0-1ae8-427b-bb5a-a628af646d4c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (4be31983-76fd-4267-b2a1-c5cf8c2a29ba), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:03:59.695361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[648659b0-7b50-4f68-bc6b-59d7ecce1402]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:03:59.695959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'7d0732f2-b77d-4ee1-a9e9-7bf8e7736171', '9c8df3fc-5ba4-4d5b-a201-b5269c461008', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba'} removed Oct 16 01:03:59.791387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:03:59.793150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 12 from net-id = 3e12ae87-77ee-4d05-8dce-be1b6f55d51c, seg-id = 390 Oct 16 01:03:59.816752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8c9f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:59.820679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416f3c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4486}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:03:59.821395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:436 - treat_devices_removed completed in 0.201 Oct 16 01:03:59.821395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:436 - ports processed. Elapsed:0.493 Oct 16 01:03:59.821677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.493 Oct 16 01:03:59.969787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7cbc2a0-1ae8-427b-bb5a-a628af646d4c admin admin] Resource Network deleted: 3e12ae87-77ee-4d05-8dce-be1b6f55d51c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:03:59.970226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7cbc2a0-1ae8-427b-bb5a-a628af646d4c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (3e12ae87-77ee-4d05-8dce-be1b6f55d51c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:00.869604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d4e913e6-3f17-4852-8a8a-561ba9549952 admin admin] Resource Port deleted: 5a7f9645-4a05-4db1-b67e-c1272d395572 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:00.876086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d4e913e6-3f17-4852-8a8a-561ba9549952 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (5a7f9645-4a05-4db1-b67e-c1272d395572), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:01.329850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:437 started Oct 16 01:04:01.332936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f3e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=976000000,duration_sec=907,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:01.333581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:01.334032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:437 - starting polling. Elapsed:0.004 Oct 16 01:04:01.337291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:01.342288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-5a7f9645-4a, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:04:01.352292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f40,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:01.354550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4be31983-76fd-4267-b2a1-c5cf8c2a29ba not present in bridge br-int Oct 16 01:04:01.354937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:04:01.355240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['5a7f9645-4a05-4db1-b67e-c1272d395572', '4be31983-76fd-4267-b2a1-c5cf8c2a29ba'] Oct 16 01:04:01.355645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4be31983-76fd-4267-b2a1-c5cf8c2a29ba is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:04:01.356015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:04:01.407439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ce308-0649-4aed-a977-b4e6e01c3768]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:04:01.413604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:437 - port information retrieved. Elapsed:0.084 Oct 16 01:04:01.414054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.084 Oct 16 01:04:02.331363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9c42353d-9a61-44d8-92ce-328e00d2ba39","delete","qr-5a7f9645-4a",34,["map",[["attached-mac","fa:16:3e:b4:5d:95"],["iface-id","5a7f9645-4a05-4db1-b67e-c1272d395572"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:04:02.397927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-312927a4-484e-4232-aef9-6ee56a16fcdb admin admin] Resource Port deleted: d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:02.398322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-312927a4-484e-4232-aef9-6ee56a16fcdb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:02.750526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f7073b4a-fcc2-46e8-92cb-e9303a35b65f","delete","qg-d85e9b46-c5",35,["map",[["attached-mac","fa:16:3e:73:82:9d"],["iface-id","d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:04:02.799791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 6->7). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:04:02.800211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:02.868551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cd40a67d-11a1-41a2-9534-10e912970274 admin admin] Resource Subnet deleted: eb1d1d52-49a0-420b-bb3c-58555bc61df7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:02.868927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cd40a67d-11a1-41a2-9534-10e912970274 admin admin] Publish callbacks [] for Subnet (eb1d1d52-49a0-420b-bb3c-58555bc61df7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:03.003826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ee69c24-1a70-4008-ae49-b6e54ca571c6","delete","tap73b1010c-4f",33,["map",[["attached-mac","fa:16:3e:dd:3e:77"],["iface-id","73b1010c-4f64-4e77-9033-9c0c75eb24b8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:04:03.331450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:438 started Oct 16 01:04:03.336455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f42,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=978000000,duration_sec=909,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:03.338483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:03.339396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:438 - starting polling. Elapsed:0.008 Oct 16 01:04:03.342440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:03.355808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f44,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:03.359609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f46,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:03.362281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f48,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:03.362828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:438 - port information retrieved. Elapsed:0.032 Oct 16 01:04:03.364943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', '6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '3a245083-425c-44d7-b1c7-ff24d35e844e', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', '5a7f9645-4a05-4db1-b67e-c1272d395572', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:04:03.365399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:438 - agent port security group processed in 0.000 Oct 16 01:04:03.368024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:04:03.368340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', '5a7f9645-4a05-4db1-b67e-c1272d395572', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'} Oct 16 01:04:03.370477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 5a7f9645-4a05-4db1-b67e-c1272d395572 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:04:03.370978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:04:03.430318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a6c097-be15-4899-95ae-cfa3eb7a4fa1]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:04:03.431075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'d85e9b46-c5c3-40a8-84b0-c97bddb2d3e1', '5a7f9645-4a05-4db1-b67e-c1272d395572', '73b1010c-4f64-4e77-9033-9c0c75eb24b8'} removed Oct 16 01:04:03.621791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:04:03.622423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:04:03.622979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 13 from net-id = ca7ce9c8-87fe-4660-9181-036527e2bb59, seg-id = 389 Oct 16 01:04:03.625403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-53c8d7c3-fe04-47eb-9968-1c62ff90d20e None None] Resource Port deleted: 73b1010c-4f64-4e77-9033-9c0c75eb24b8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:03.626113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-53c8d7c3-fe04-47eb-9968-1c62ff90d20e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (73b1010c-4f64-4e77-9033-9c0c75eb24b8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:03.636969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8ca1,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:03.640878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416f4a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4485}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:03.641901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:438 - treat_devices_removed completed in 0.273 Oct 16 01:04:03.642399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:438 - ports processed. Elapsed:0.311 Oct 16 01:04:03.642998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.312 Oct 16 01:04:03.643940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ae43f477-bce5-4b46-bb68-c2e8332730cf admin admin] Resource Port deleted: 73b1010c-4f64-4e77-9033-9c0c75eb24b8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:03.644369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ae43f477-bce5-4b46-bb68-c2e8332730cf admin admin] Skipped duplicate delete event for 73b1010c-4f64-4e77-9033-9c0c75eb24b8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 01:04:03.877400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ae43f477-bce5-4b46-bb68-c2e8332730cf admin admin] Resource Network deleted: ca7ce9c8-87fe-4660-9181-036527e2bb59 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:03.877784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ae43f477-bce5-4b46-bb68-c2e8332730cf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (ca7ce9c8-87fe-4660-9181-036527e2bb59), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.197181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Resource SecurityGroup deleted: 55d9e52b-b53a-433b-b3a4-a72e6e3f2b56 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.197645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (55d9e52b-b53a-433b-b3a4-a72e6e3f2b56), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.198241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('55d9e52b-b53a-433b-b3a4-a72e6e3f2b56',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:04.212128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('55d9e52b-b53a-433b-b3a4-a72e6e3f2b56',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:04.213138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Resource SecurityGroupRule deleted: 027c1e85-7cde-48d0-8747-4b9fc9000bba {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.213520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (027c1e85-7cde-48d0-8747-4b9fc9000bba), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.213867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:04:04.214275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Resource SecurityGroupRule deleted: 0388f61f-e7b7-4a25-9a2a-7ee534b2cf2c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.214774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0388f61f-e7b7-4a25-9a2a-7ee534b2cf2c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.215156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:04:04.215542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Resource SecurityGroupRule deleted: 38105740-3bc2-4c5e-a316-a02091f30ad9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.215893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (38105740-3bc2-4c5e-a316-a02091f30ad9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.216220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:04:04.216599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Resource SecurityGroupRule deleted: 6cbf519b-f37b-492f-8b80-8e5585c5ffce {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.216952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6cbf519b-f37b-492f-8b80-8e5585c5ffce), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.217277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-325ab895-51b5-455b-9013-c93117d803af admin admin] Security group rule updated ['55d9e52b-b53a-433b-b3a4-a72e6e3f2b56'] Oct 16 01:04:04.775513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Resource SecurityGroup deleted: fb0998b3-74cd-4627-a1e8-57c2074611aa {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.776069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (fb0998b3-74cd-4627-a1e8-57c2074611aa), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.776377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fb0998b3-74cd-4627-a1e8-57c2074611aa',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:04.820417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fb0998b3-74cd-4627-a1e8-57c2074611aa',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:04.820724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Resource SecurityGroupRule deleted: 576f33dc-45cd-47d1-bd7a-2ac2e2f6481a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.821108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (576f33dc-45cd-47d1-bd7a-2ac2e2f6481a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.821498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:04:04.822320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Resource SecurityGroupRule deleted: 8404294b-f34b-48bd-87fb-e14a1ff02647 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.822684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8404294b-f34b-48bd-87fb-e14a1ff02647), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.823051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:04:04.823433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Resource SecurityGroupRule deleted: a19c003f-a0e1-4b6e-811b-a4d51c2776ff {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.823786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a19c003f-a0e1-4b6e-811b-a4d51c2776ff), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.824112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:04:04.824631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Resource SecurityGroupRule deleted: e0fa7e8b-7df9-4c74-b13c-82becde84a83 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:04.824989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e0fa7e8b-7df9-4c74-b13c-82becde84a83), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:04.825397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-77dbc983-0ff6-4477-8f95-0c3b2cc377b7 admin admin] Security group rule updated ['fb0998b3-74cd-4627-a1e8-57c2074611aa'] Oct 16 01:04:04.845164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port a16383c6-9bce-4108-ad57-fad77bb41e2b updated (revision_number 7->8). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:04:04.845556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.249412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:05Z,description='Default security group',id=4cc12798-89f0-41cc-9058-6b5a46938158,is_default=True,name='default',project_id='5fe7780fa7f141e89f06bc9e9cbb7b78',revision_number=1,rules=[SecurityGroupRule(7a364ecb-bb23-45ce-a83c-9d45889aa420),SecurityGroupRule(c9089250-ea54-4ab4-9d18-c567a5ac61b1),SecurityGroupRule(d0f90192-8aaa-4924-8ef6-90cc85aaaf50),SecurityGroupRule(dcb4b4c4-e1aa-421d-97f0-97b666d3d6df)],shared=False,stateful=True,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.249878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (4cc12798-89f0-41cc-9058-6b5a46938158), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.250602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='egress',ethertype='IPv6',id=7a364ecb-bb23-45ce-a83c-9d45889aa420,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5fe7780fa7f141e89f06bc9e9cbb7b78',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4cc12798-89f0-41cc-9058-6b5a46938158,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.251003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7a364ecb-bb23-45ce-a83c-9d45889aa420), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.251349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.252049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='ingress',ethertype='IPv4',id=c9089250-ea54-4ab4-9d18-c567a5ac61b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5fe7780fa7f141e89f06bc9e9cbb7b78',protocol=,remote_address_group_id=,remote_group_id=4cc12798-89f0-41cc-9058-6b5a46938158,remote_ip_prefix=,revision_number=0,security_group_id=4cc12798-89f0-41cc-9058-6b5a46938158,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.252409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c9089250-ea54-4ab4-9d18-c567a5ac61b1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.252845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.253417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='ingress',ethertype='IPv6',id=d0f90192-8aaa-4924-8ef6-90cc85aaaf50,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5fe7780fa7f141e89f06bc9e9cbb7b78',protocol=,remote_address_group_id=,remote_group_id=4cc12798-89f0-41cc-9058-6b5a46938158,remote_ip_prefix=,revision_number=0,security_group_id=4cc12798-89f0-41cc-9058-6b5a46938158,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.253776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d0f90192-8aaa-4924-8ef6-90cc85aaaf50), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.254110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.254769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='egress',ethertype='IPv4',id=dcb4b4c4-e1aa-421d-97f0-97b666d3d6df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5fe7780fa7f141e89f06bc9e9cbb7b78',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4cc12798-89f0-41cc-9058-6b5a46938158,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.255163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dcb4b4c4-e1aa-421d-97f0-97b666d3d6df), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.255570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-efd03b94-ef90-41f0-9f46-56f6c4bb4e11 admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.332715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:439 started Oct 16 01:04:05.336092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f4c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=979000000,duration_sec=911,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:05.336681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:05.337026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:439 - starting polling. Elapsed:0.005 Oct 16 01:04:05.340072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.341963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 73b1010c-4f64-4e77-9033-9c0c75eb24b8 not present in bridge br-int Oct 16 01:04:05.342309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:04:05.342600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['73b1010c-4f64-4e77-9033-9c0c75eb24b8'] Oct 16 01:04:05.342950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 73b1010c-4f64-4e77-9033-9c0c75eb24b8 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:04:05.346675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:439 - port information retrieved. Elapsed:0.014 Oct 16 01:04:05.347051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 01:04:05.383464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Resource SecurityGroup deleted: 4cc12798-89f0-41cc-9058-6b5a46938158 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.383921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (4cc12798-89f0-41cc-9058-6b5a46938158), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.384507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4cc12798-89f0-41cc-9058-6b5a46938158',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:05.398046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4cc12798-89f0-41cc-9058-6b5a46938158',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:05.398725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Resource SecurityGroupRule deleted: 7a364ecb-bb23-45ce-a83c-9d45889aa420 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.399157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7a364ecb-bb23-45ce-a83c-9d45889aa420), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.399517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.400095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Resource SecurityGroupRule deleted: c9089250-ea54-4ab4-9d18-c567a5ac61b1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.400737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c9089250-ea54-4ab4-9d18-c567a5ac61b1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.401222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.401987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Resource SecurityGroupRule deleted: d0f90192-8aaa-4924-8ef6-90cc85aaaf50 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.402583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d0f90192-8aaa-4924-8ef6-90cc85aaaf50), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.403535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.404094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Resource SecurityGroupRule deleted: dcb4b4c4-e1aa-421d-97f0-97b666d3d6df {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.404747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dcb4b4c4-e1aa-421d-97f0-97b666d3d6df), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.405092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7d33a512-be4f-4f6e-a358-cbb1547cdd7d admin admin] Security group rule updated ['4cc12798-89f0-41cc-9058-6b5a46938158'] Oct 16 01:04:05.788784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:05Z,description='Default security group',id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,is_default=True,name='default',project_id='68b1319516144f958fd2daf6fc42b42e',revision_number=1,rules=[SecurityGroupRule(0733ff0d-aa66-4d0f-8ae7-815f38fc45e5),SecurityGroupRule(4153f7a3-c0d6-49f4-bc41-6de6bf630563),SecurityGroupRule(bc231cf6-0a9c-477b-a2e4-52d27eb9cb5c),SecurityGroupRule(cbb1d94d-6071-4dc6-af90-9260e89f6e95)],shared=False,stateful=True,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.789437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (aad9a5a2-1f21-4007-8f9e-418123bc0c4d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.789798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='egress',ethertype='IPv4',id=0733ff0d-aa66-4d0f-8ae7-815f38fc45e5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68b1319516144f958fd2daf6fc42b42e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.790166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0733ff0d-aa66-4d0f-8ae7-815f38fc45e5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.790508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.791226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='ingress',ethertype='IPv4',id=4153f7a3-c0d6-49f4-bc41-6de6bf630563,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68b1319516144f958fd2daf6fc42b42e',protocol=,remote_address_group_id=,remote_group_id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,remote_ip_prefix=,revision_number=0,security_group_id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.791587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4153f7a3-c0d6-49f4-bc41-6de6bf630563), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.791927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.792592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='ingress',ethertype='IPv6',id=bc231cf6-0a9c-477b-a2e4-52d27eb9cb5c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68b1319516144f958fd2daf6fc42b42e',protocol=,remote_address_group_id=,remote_group_id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,remote_ip_prefix=,revision_number=0,security_group_id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.792950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (bc231cf6-0a9c-477b-a2e4-52d27eb9cb5c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.793303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.793965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:05Z,description=,direction='egress',ethertype='IPv6',id=cbb1d94d-6071-4dc6-af90-9260e89f6e95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68b1319516144f958fd2daf6fc42b42e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aad9a5a2-1f21-4007-8f9e-418123bc0c4d,updated_at=2022-10-16T01:04:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:05.794322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (cbb1d94d-6071-4dc6-af90-9260e89f6e95), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.794654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-84844727-3d99-4aeb-96aa-f298208a31ae admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.931010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Resource SecurityGroup deleted: aad9a5a2-1f21-4007-8f9e-418123bc0c4d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.931391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (aad9a5a2-1f21-4007-8f9e-418123bc0c4d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.931902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('aad9a5a2-1f21-4007-8f9e-418123bc0c4d',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:05.953711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('aad9a5a2-1f21-4007-8f9e-418123bc0c4d',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:05.954374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Resource SecurityGroupRule deleted: 0733ff0d-aa66-4d0f-8ae7-815f38fc45e5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.954751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0733ff0d-aa66-4d0f-8ae7-815f38fc45e5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.955184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.955837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Resource SecurityGroupRule deleted: 4153f7a3-c0d6-49f4-bc41-6de6bf630563 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.956305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4153f7a3-c0d6-49f4-bc41-6de6bf630563), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.956981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.957325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Resource SecurityGroupRule deleted: bc231cf6-0a9c-477b-a2e4-52d27eb9cb5c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.957848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (bc231cf6-0a9c-477b-a2e4-52d27eb9cb5c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.958174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:05.958551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Resource SecurityGroupRule deleted: cbb1d94d-6071-4dc6-af90-9260e89f6e95 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:05.958909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (cbb1d94d-6071-4dc6-af90-9260e89f6e95), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:05.959233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d19da017-debb-4e0b-ab7d-4f49dd477e27 admin admin] Security group rule updated ['aad9a5a2-1f21-4007-8f9e-418123bc0c4d'] Oct 16 01:04:07.320813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:07Z,description='Default security group',id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,is_default=True,name='default',project_id='fc46802e590646148357aec816608ed7',revision_number=1,rules=[SecurityGroupRule(2d60b5a6-4712-4d34-a0d5-efb103bc9c57),SecurityGroupRule(55f22c12-ef58-4412-8dff-77da2e5c2b46),SecurityGroupRule(5771d678-8746-4265-a649-e9219b0ab22c),SecurityGroupRule(da27ffe9-c617-44a5-992e-2af8e7a26d5b)],shared=False,stateful=True,updated_at=2022-10-16T01:04:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:07.321443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (97eddbbb-4fae-4bf6-a6d8-418277aa855f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.322140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:07Z,description=,direction='egress',ethertype='IPv6',id=2d60b5a6-4712-4d34-a0d5-efb103bc9c57,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc46802e590646148357aec816608ed7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,updated_at=2022-10-16T01:04:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:07.322516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2d60b5a6-4712-4d34-a0d5-efb103bc9c57), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.323028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.323821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:07Z,description=,direction='ingress',ethertype='IPv4',id=55f22c12-ef58-4412-8dff-77da2e5c2b46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc46802e590646148357aec816608ed7',protocol=,remote_address_group_id=,remote_group_id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,remote_ip_prefix=,revision_number=0,security_group_id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,updated_at=2022-10-16T01:04:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:07.324199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (55f22c12-ef58-4412-8dff-77da2e5c2b46), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.324645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.325320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:07Z,description=,direction='ingress',ethertype='IPv6',id=5771d678-8746-4265-a649-e9219b0ab22c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc46802e590646148357aec816608ed7',protocol=,remote_address_group_id=,remote_group_id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,remote_ip_prefix=,revision_number=0,security_group_id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,updated_at=2022-10-16T01:04:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:07.325678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5771d678-8746-4265-a649-e9219b0ab22c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.326009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.326671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:07Z,description=,direction='egress',ethertype='IPv4',id=da27ffe9-c617-44a5-992e-2af8e7a26d5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc46802e590646148357aec816608ed7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=97eddbbb-4fae-4bf6-a6d8-418277aa855f,updated_at=2022-10-16T01:04:07Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:07.327060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (da27ffe9-c617-44a5-992e-2af8e7a26d5b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.327417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6e5577b0-bd70-4385-90c4-b0f3670c3bcb admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.333917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:440 started Oct 16 01:04:07.337280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f4e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=980000000,duration_sec=913,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:07.337870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:07.338231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:07.460500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Resource SecurityGroup deleted: 97eddbbb-4fae-4bf6-a6d8-418277aa855f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:07.460892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (97eddbbb-4fae-4bf6-a6d8-418277aa855f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.461362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('97eddbbb-4fae-4bf6-a6d8-418277aa855f',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:07.473625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('97eddbbb-4fae-4bf6-a6d8-418277aa855f',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:07.474160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Resource SecurityGroupRule deleted: 2d60b5a6-4712-4d34-a0d5-efb103bc9c57 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:07.474546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2d60b5a6-4712-4d34-a0d5-efb103bc9c57), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.474887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.475521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Resource SecurityGroupRule deleted: 55f22c12-ef58-4412-8dff-77da2e5c2b46 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:07.475996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (55f22c12-ef58-4412-8dff-77da2e5c2b46), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.476524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.477061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Resource SecurityGroupRule deleted: 5771d678-8746-4265-a649-e9219b0ab22c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:07.477415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5771d678-8746-4265-a649-e9219b0ab22c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.477765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:07.478143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Resource SecurityGroupRule deleted: da27ffe9-c617-44a5-992e-2af8e7a26d5b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:07.478485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (da27ffe9-c617-44a5-992e-2af8e7a26d5b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:07.478820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-82c03102-ed11-4a34-820e-697dc0a704a9 admin admin] Security group rule updated ['97eddbbb-4fae-4bf6-a6d8-418277aa855f'] Oct 16 01:04:09.335412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:441 started Oct 16 01:04:09.338199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f50,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=981000000,duration_sec=915,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:09.338804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:09.339202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:11.336225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:442 started Oct 16 01:04:11.338743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f52,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=982000000,duration_sec=917,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:11.339389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:11.339757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:13.337863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:443 started Oct 16 01:04:13.340327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f54,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=983000000,duration_sec=919,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:13.340929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:13.341283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:15.338843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:444 started Oct 16 01:04:15.341685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f56,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=985000000,duration_sec=921,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:15.342280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:15.342640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:17.340064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:445 started Oct 16 01:04:17.342375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f58,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=985000000,duration_sec=923,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:17.342999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:17.343358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:19.340926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:446 started Oct 16 01:04:19.343323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f5a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=986000000,duration_sec=925,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:19.343883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:19.344236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:04:21.341678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:447 started Oct 16 01:04:21.344083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f5c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=987000000,duration_sec=927,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:21.344658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:21.345015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:23.342848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:448 started Oct 16 01:04:23.345688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f5e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=988000000,duration_sec=929,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:23.346262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:23.346618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:25.344131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:449 started Oct 16 01:04:25.346645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f60,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=990000000,duration_sec=931,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:25.347246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:25.347624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:27.345968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:27Z,description='Default security group',id=06514435-e0ee-49b6-8d99-7cc73becfbd5,is_default=True,name='default',project_id='f9ad83b53a08431696ba4fd2f6d519eb',revision_number=1,rules=[SecurityGroupRule(2748fa8f-b1ed-4ec3-af9a-d56e8c2a88f9),SecurityGroupRule(9fdf4c2b-9871-4875-be02-4ec292524a99),SecurityGroupRule(afb5a4e5-3f38-4709-8233-f842abae8ba4),SecurityGroupRule(b799bb0a-072b-4634-8ef6-f3a485e0237b)],shared=False,stateful=True,updated_at=2022-10-16T01:04:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:27.346619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (06514435-e0ee-49b6-8d99-7cc73becfbd5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.347003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:27Z,description=,direction='ingress',ethertype='IPv4',id=2748fa8f-b1ed-4ec3-af9a-d56e8c2a88f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9ad83b53a08431696ba4fd2f6d519eb',protocol=,remote_address_group_id=,remote_group_id=06514435-e0ee-49b6-8d99-7cc73becfbd5,remote_ip_prefix=,revision_number=0,security_group_id=06514435-e0ee-49b6-8d99-7cc73becfbd5,updated_at=2022-10-16T01:04:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:27.347362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2748fa8f-b1ed-4ec3-af9a-d56e8c2a88f9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.347699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.348484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:27Z,description=,direction='egress',ethertype='IPv6',id=9fdf4c2b-9871-4875-be02-4ec292524a99,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9ad83b53a08431696ba4fd2f6d519eb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=06514435-e0ee-49b6-8d99-7cc73becfbd5,updated_at=2022-10-16T01:04:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:27.348837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9fdf4c2b-9871-4875-be02-4ec292524a99), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.349972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.350666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:27Z,description=,direction='egress',ethertype='IPv4',id=afb5a4e5-3f38-4709-8233-f842abae8ba4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9ad83b53a08431696ba4fd2f6d519eb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=06514435-e0ee-49b6-8d99-7cc73becfbd5,updated_at=2022-10-16T01:04:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:27.351071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (afb5a4e5-3f38-4709-8233-f842abae8ba4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.351398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.352052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:27Z,description=,direction='ingress',ethertype='IPv6',id=b799bb0a-072b-4634-8ef6-f3a485e0237b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f9ad83b53a08431696ba4fd2f6d519eb',protocol=,remote_address_group_id=,remote_group_id=06514435-e0ee-49b6-8d99-7cc73becfbd5,remote_ip_prefix=,revision_number=0,security_group_id=06514435-e0ee-49b6-8d99-7cc73becfbd5,updated_at=2022-10-16T01:04:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:27.352421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b799bb0a-072b-4634-8ef6-f3a485e0237b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.352732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c65eb28e-5a48-4963-a10f-caa0adbfcc47 admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.353249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:450 started Oct 16 01:04:27.355953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f62,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=999000000,duration_sec=933,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:27.356861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:27.357213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:27.482418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Resource SecurityGroup deleted: 06514435-e0ee-49b6-8d99-7cc73becfbd5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:27.482799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (06514435-e0ee-49b6-8d99-7cc73becfbd5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.483315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('06514435-e0ee-49b6-8d99-7cc73becfbd5',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:27.496038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('06514435-e0ee-49b6-8d99-7cc73becfbd5',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:27.496543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Resource SecurityGroupRule deleted: 2748fa8f-b1ed-4ec3-af9a-d56e8c2a88f9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:27.496945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2748fa8f-b1ed-4ec3-af9a-d56e8c2a88f9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.497281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.497704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Resource SecurityGroupRule deleted: 9fdf4c2b-9871-4875-be02-4ec292524a99 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:27.498053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9fdf4c2b-9871-4875-be02-4ec292524a99), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.498376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.498747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Resource SecurityGroupRule deleted: afb5a4e5-3f38-4709-8233-f842abae8ba4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:27.499122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (afb5a4e5-3f38-4709-8233-f842abae8ba4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.499419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:27.499788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Resource SecurityGroupRule deleted: b799bb0a-072b-4634-8ef6-f3a485e0237b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:27.500126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b799bb0a-072b-4634-8ef6-f3a485e0237b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:27.500450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f8489de9-56e9-415c-999e-33263248709f admin admin] Security group rule updated ['06514435-e0ee-49b6-8d99-7cc73becfbd5'] Oct 16 01:04:29.354168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:451 started Oct 16 01:04:29.357440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f64,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=0,duration_sec=936,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:29.358019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:29.358379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:31.355294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:452 started Oct 16 01:04:31.357954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f66,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=1000000,duration_sec=938,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:31.358522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:31.359007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:31.840149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:31Z,description='Default security group',id=429853f9-da32-40ed-9a6d-83e59e33002c,is_default=True,name='default',project_id='6a6d4660fe584fd4a1d4fbb73c23778f',revision_number=1,rules=[SecurityGroupRule(612249c3-331f-4cd8-af19-48bc375e0f09),SecurityGroupRule(6163ced2-b2e5-4154-8244-dbbade19fc58),SecurityGroupRule(92586b45-d305-4e27-bf57-fccc1e3d4219),SecurityGroupRule(f6f7e423-bf68-4164-a37a-9423c6d3437d)],shared=False,stateful=True,updated_at=2022-10-16T01:04:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:31.840542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (429853f9-da32-40ed-9a6d-83e59e33002c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.841188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:31Z,description=,direction='ingress',ethertype='IPv6',id=612249c3-331f-4cd8-af19-48bc375e0f09,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6a6d4660fe584fd4a1d4fbb73c23778f',protocol=,remote_address_group_id=,remote_group_id=429853f9-da32-40ed-9a6d-83e59e33002c,remote_ip_prefix=,revision_number=0,security_group_id=429853f9-da32-40ed-9a6d-83e59e33002c,updated_at=2022-10-16T01:04:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:31.841560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (612249c3-331f-4cd8-af19-48bc375e0f09), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.841906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.842597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:31Z,description=,direction='ingress',ethertype='IPv4',id=6163ced2-b2e5-4154-8244-dbbade19fc58,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6a6d4660fe584fd4a1d4fbb73c23778f',protocol=,remote_address_group_id=,remote_group_id=429853f9-da32-40ed-9a6d-83e59e33002c,remote_ip_prefix=,revision_number=0,security_group_id=429853f9-da32-40ed-9a6d-83e59e33002c,updated_at=2022-10-16T01:04:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:31.842992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6163ced2-b2e5-4154-8244-dbbade19fc58), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.843332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.844039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:31Z,description=,direction='egress',ethertype='IPv4',id=92586b45-d305-4e27-bf57-fccc1e3d4219,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6a6d4660fe584fd4a1d4fbb73c23778f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=429853f9-da32-40ed-9a6d-83e59e33002c,updated_at=2022-10-16T01:04:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:31.844363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (92586b45-d305-4e27-bf57-fccc1e3d4219), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.844700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.845362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:31Z,description=,direction='egress',ethertype='IPv6',id=f6f7e423-bf68-4164-a37a-9423c6d3437d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6a6d4660fe584fd4a1d4fbb73c23778f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=429853f9-da32-40ed-9a6d-83e59e33002c,updated_at=2022-10-16T01:04:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:31.845723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f6f7e423-bf68-4164-a37a-9423c6d3437d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.846057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a661d990-d3c3-44f0-a1ad-3edaaff80ce3 admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.980962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Resource SecurityGroup deleted: 429853f9-da32-40ed-9a6d-83e59e33002c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:31.981420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (429853f9-da32-40ed-9a6d-83e59e33002c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.981896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('429853f9-da32-40ed-9a6d-83e59e33002c',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:31.995537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('429853f9-da32-40ed-9a6d-83e59e33002c',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:31.996022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Resource SecurityGroupRule deleted: 612249c3-331f-4cd8-af19-48bc375e0f09 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:31.996400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (612249c3-331f-4cd8-af19-48bc375e0f09), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.996735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.997134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Resource SecurityGroupRule deleted: 6163ced2-b2e5-4154-8244-dbbade19fc58 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:31.997537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6163ced2-b2e5-4154-8244-dbbade19fc58), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.997797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.998173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Resource SecurityGroupRule deleted: 92586b45-d305-4e27-bf57-fccc1e3d4219 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:31.998551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (92586b45-d305-4e27-bf57-fccc1e3d4219), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:31.998893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:31.999273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Resource SecurityGroupRule deleted: f6f7e423-bf68-4164-a37a-9423c6d3437d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:31.999835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f6f7e423-bf68-4164-a37a-9423c6d3437d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:32.000152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89c81f7c-847e-4849-bc57-b2a6b34888eb admin admin] Security group rule updated ['429853f9-da32-40ed-9a6d-83e59e33002c'] Oct 16 01:04:33.356953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:453 started Oct 16 01:04:33.360003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f68,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=3000000,duration_sec=940,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:33.360712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:33.361127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:35.358384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:454 started Oct 16 01:04:35.361006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f6a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=4000000,duration_sec=942,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:35.361638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:35.361992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:37.359326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:455 started Oct 16 01:04:37.361891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f6c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=5000000,duration_sec=944,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:37.362511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:37.363090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:38.568620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-073c034c-35ac-46a9-b12e-4e3ab9b36e53 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource Port deleted: 544a970e-fd66-4b0a-ba39-0dcfeed391f8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:38.569210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-073c034c-35ac-46a9-b12e-4e3ab9b36e53 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (544a970e-fd66-4b0a-ba39-0dcfeed391f8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:38.569210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-073c034c-35ac-46a9-b12e-4e3ab9b36e53 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group member updated {'7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'} Oct 16 01:04:39.360756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:456 started Oct 16 01:04:39.364992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f6e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=7000000,duration_sec=946,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:39.365723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:39.366210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:456 - starting polling. Elapsed:0.006 Oct 16 01:04:39.369256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:39.371460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 not present in bridge br-int Oct 16 01:04:39.371806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:04:39.372102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['544a970e-fd66-4b0a-ba39-0dcfeed391f8'] Oct 16 01:04:39.372432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 544a970e-fd66-4b0a-ba39-0dcfeed391f8 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:04:39.376240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:456 - port information retrieved. Elapsed:0.016 Oct 16 01:04:39.376576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 16 01:04:40.308767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroup deleted: 7a302bbe-1b5a-4b2e-b9f1-c83b17171a75 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.309778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (7a302bbe-1b5a-4b2e-b9f1-c83b17171a75), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.310222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7a302bbe-1b5a-4b2e-b9f1-c83b17171a75',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:40.325193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7a302bbe-1b5a-4b2e-b9f1-c83b17171a75',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:40.326132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: 7acf5b9d-cb30-40be-ace3-b109df7f4493 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.326687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7acf5b9d-cb30-40be-ace3-b109df7f4493), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.327189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:04:40.327585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: b764117e-e126-439e-8de6-9c297253f3fe {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.327930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b764117e-e126-439e-8de6-9c297253f3fe), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.328243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:04:40.329153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: b8830810-32d4-4b25-a1a0-7c0904b05a25 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.329810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b8830810-32d4-4b25-a1a0-7c0904b05a25), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.329968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:04:40.331055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource SecurityGroupRule deleted: 8c5ee50f-5bda-41e4-82a7-41902f13e883 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.331707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8c5ee50f-5bda-41e4-82a7-41902f13e883), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.332179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3c23b3b7-cadb-460c-bd5e-52c97afe2289 tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Security group rule updated ['7a302bbe-1b5a-4b2e-b9f1-c83b17171a75'] Oct 16 01:04:40.646226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:40Z,description='Default security group',id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,is_default=True,name='default',project_id='2ff5f5f46abe47c3bf0768ff55cd163d',revision_number=1,rules=[SecurityGroupRule(4b364cad-fe64-44bf-8e61-a721b899b8fc),SecurityGroupRule(6dcf3efa-43bc-4c14-9652-1e1ab46e73e9),SecurityGroupRule(b15eaa58-1b2e-454c-b5c4-35c3ad3fcfbf),SecurityGroupRule(dde18fdd-f69e-45d4-8335-45671991bbc6)],shared=False,stateful=True,updated_at=2022-10-16T01:04:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:40.646715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.647950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:40Z,description=,direction='ingress',ethertype='IPv6',id=4b364cad-fe64-44bf-8e61-a721b899b8fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff5f5f46abe47c3bf0768ff55cd163d',protocol=,remote_address_group_id=,remote_group_id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,remote_ip_prefix=,revision_number=0,security_group_id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,updated_at=2022-10-16T01:04:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:40.648522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4b364cad-fe64-44bf-8e61-a721b899b8fc), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.648752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.649663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:40Z,description=,direction='egress',ethertype='IPv6',id=6dcf3efa-43bc-4c14-9652-1e1ab46e73e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff5f5f46abe47c3bf0768ff55cd163d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,updated_at=2022-10-16T01:04:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:40.650012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6dcf3efa-43bc-4c14-9652-1e1ab46e73e9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.650352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.651058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:40Z,description=,direction='ingress',ethertype='IPv4',id=b15eaa58-1b2e-454c-b5c4-35c3ad3fcfbf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff5f5f46abe47c3bf0768ff55cd163d',protocol=,remote_address_group_id=,remote_group_id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,remote_ip_prefix=,revision_number=0,security_group_id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,updated_at=2022-10-16T01:04:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:40.651420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b15eaa58-1b2e-454c-b5c4-35c3ad3fcfbf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.651755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.652419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:40Z,description=,direction='egress',ethertype='IPv4',id=dde18fdd-f69e-45d4-8335-45671991bbc6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff5f5f46abe47c3bf0768ff55cd163d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a,updated_at=2022-10-16T01:04:40Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:40.652794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (dde18fdd-f69e-45d4-8335-45671991bbc6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.653113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c157976a-686b-4086-85fa-7daa082af5bc admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.787453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-026ade61-78c6-481c-87e4-258ea612487f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Resource Port deleted: 7cec60c5-5837-4d17-acde-a907096deefb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.787843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-026ade61-78c6-481c-87e4-258ea612487f tempest-AttachVolumeShelveTestJSON-1148799462 tempest-AttachVolumeShelveTestJSON-1148799462-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (7cec60c5-5837-4d17-acde-a907096deefb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.934985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Resource SecurityGroup deleted: 9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.935526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.936126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:40.954707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:40.955279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Resource SecurityGroupRule deleted: 4b364cad-fe64-44bf-8e61-a721b899b8fc {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.955654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4b364cad-fe64-44bf-8e61-a721b899b8fc), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.955992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.956394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Resource SecurityGroupRule deleted: 6dcf3efa-43bc-4c14-9652-1e1ab46e73e9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.956750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6dcf3efa-43bc-4c14-9652-1e1ab46e73e9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.957085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.957469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Resource SecurityGroupRule deleted: b15eaa58-1b2e-454c-b5c4-35c3ad3fcfbf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.958518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b15eaa58-1b2e-454c-b5c4-35c3ad3fcfbf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.958849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:40.959758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Resource SecurityGroupRule deleted: dde18fdd-f69e-45d4-8335-45671991bbc6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:40.959887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dde18fdd-f69e-45d4-8335-45671991bbc6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:40.960160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4e1f9121-178f-4358-abf1-f513080efaa6 admin admin] Security group rule updated ['9c1e7656-40cb-4ccd-9983-e2a4fbd6b97a'] Oct 16 01:04:41.361666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:457 started Oct 16 01:04:41.364899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f70,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=7000000,duration_sec=948,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:41.365611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:41.365991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:457 - starting polling. Elapsed:0.004 Oct 16 01:04:41.369206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.371464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 7cec60c5-5837-4d17-acde-a907096deefb not present in bridge br-int Oct 16 01:04:41.371867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:04:41.372220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['7cec60c5-5837-4d17-acde-a907096deefb'] Oct 16 01:04:41.372612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 7cec60c5-5837-4d17-acde-a907096deefb is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:04:41.376492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:457 - port information retrieved. Elapsed:0.015 Oct 16 01:04:41.376902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 01:04:41.381854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:41Z,description='Default security group',id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,is_default=True,name='default',project_id='9eda319fd07542cf835907fd935bb29d',revision_number=1,rules=[SecurityGroupRule(27823f49-92eb-4ff8-9ad8-133e4c2527e9),SecurityGroupRule(47d5d050-a70a-447d-ae60-4b6cbec69fd9),SecurityGroupRule(6b55143f-7027-43b4-8200-599a3205f619),SecurityGroupRule(df4cd829-4c8c-467a-bb7b-91963ac08e1a)],shared=False,stateful=True,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.382309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.383028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='egress',ethertype='IPv6',id=27823f49-92eb-4ff8-9ad8-133e4c2527e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eda319fd07542cf835907fd935bb29d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.383454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (27823f49-92eb-4ff8-9ad8-133e4c2527e9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.383849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.384590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='ingress',ethertype='IPv4',id=47d5d050-a70a-447d-ae60-4b6cbec69fd9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eda319fd07542cf835907fd935bb29d',protocol=,remote_address_group_id=,remote_group_id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,remote_ip_prefix=,revision_number=0,security_group_id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.384953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (47d5d050-a70a-447d-ae60-4b6cbec69fd9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.385281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.386278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='egress',ethertype='IPv4',id=6b55143f-7027-43b4-8200-599a3205f619,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eda319fd07542cf835907fd935bb29d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.386278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6b55143f-7027-43b4-8200-599a3205f619), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.386618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.387283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='ingress',ethertype='IPv6',id=df4cd829-4c8c-467a-bb7b-91963ac08e1a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9eda319fd07542cf835907fd935bb29d',protocol=,remote_address_group_id=,remote_group_id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,remote_ip_prefix=,revision_number=0,security_group_id=1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.387634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (df4cd829-4c8c-467a-bb7b-91963ac08e1a), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.387965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0ac6a52a-1ebe-4c5d-b84b-b4bdb9277fec admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.514190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Resource SecurityGroup deleted: 1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:41.514576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.515071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:41.529672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:41.530184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Resource SecurityGroupRule deleted: 27823f49-92eb-4ff8-9ad8-133e4c2527e9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:41.530593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (27823f49-92eb-4ff8-9ad8-133e4c2527e9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.530972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.531379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Resource SecurityGroupRule deleted: 47d5d050-a70a-447d-ae60-4b6cbec69fd9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:41.531736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (47d5d050-a70a-447d-ae60-4b6cbec69fd9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.532067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.532448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Resource SecurityGroupRule deleted: 6b55143f-7027-43b4-8200-599a3205f619 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:41.532799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6b55143f-7027-43b4-8200-599a3205f619), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.533156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.533672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Resource SecurityGroupRule deleted: df4cd829-4c8c-467a-bb7b-91963ac08e1a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:41.533883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (df4cd829-4c8c-467a-bb7b-91963ac08e1a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.534207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9edc4610-b84f-4002-b56f-b9f9d2040da1 admin admin] Security group rule updated ['1dfdd45f-bce3-48eb-aa96-4e45bec8b1d4'] Oct 16 01:04:41.980082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:41Z,description='Default security group',id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,is_default=True,name='default',project_id='0faf17f64b0a43769d0a48faa991cdc2',revision_number=1,rules=[SecurityGroupRule(106679c2-3a25-4551-a607-2e9998ba0d22),SecurityGroupRule(555575f2-6248-42df-971c-22af0c7fd36c),SecurityGroupRule(7e934cb1-6b77-417f-aa18-1e563850e638),SecurityGroupRule(c6f186a5-dc2e-4844-9645-30a51aa4d2e6)],shared=False,stateful=True,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.980082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (fc3293bf-d1ef-4bfd-8975-0f5685c8629d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.980683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='egress',ethertype='IPv4',id=106679c2-3a25-4551-a607-2e9998ba0d22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0faf17f64b0a43769d0a48faa991cdc2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.981059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (106679c2-3a25-4551-a607-2e9998ba0d22), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.981427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:41.982142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='ingress',ethertype='IPv4',id=555575f2-6248-42df-971c-22af0c7fd36c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0faf17f64b0a43769d0a48faa991cdc2',protocol=,remote_address_group_id=,remote_group_id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,remote_ip_prefix=,revision_number=0,security_group_id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.982504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (555575f2-6248-42df-971c-22af0c7fd36c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.983048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:41.983746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='ingress',ethertype='IPv6',id=7e934cb1-6b77-417f-aa18-1e563850e638,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0faf17f64b0a43769d0a48faa991cdc2',protocol=,remote_address_group_id=,remote_group_id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,remote_ip_prefix=,revision_number=0,security_group_id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.984111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7e934cb1-6b77-417f-aa18-1e563850e638), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.984446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:41.985557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:41Z,description=,direction='egress',ethertype='IPv6',id=c6f186a5-dc2e-4844-9645-30a51aa4d2e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0faf17f64b0a43769d0a48faa991cdc2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fc3293bf-d1ef-4bfd-8975-0f5685c8629d,updated_at=2022-10-16T01:04:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:41.985557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c6f186a5-dc2e-4844-9645-30a51aa4d2e6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:41.985774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c7aee0ae-2827-4753-a525-88444585a561 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:42.168458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Resource SecurityGroup deleted: fc3293bf-d1ef-4bfd-8975-0f5685c8629d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:42.169103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (fc3293bf-d1ef-4bfd-8975-0f5685c8629d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:42.169841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fc3293bf-d1ef-4bfd-8975-0f5685c8629d',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:42.192372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fc3293bf-d1ef-4bfd-8975-0f5685c8629d',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:42.193042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Resource SecurityGroupRule deleted: 106679c2-3a25-4551-a607-2e9998ba0d22 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:42.193642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (106679c2-3a25-4551-a607-2e9998ba0d22), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:42.194500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:42.195522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Resource SecurityGroupRule deleted: 555575f2-6248-42df-971c-22af0c7fd36c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:42.196685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (555575f2-6248-42df-971c-22af0c7fd36c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:42.197420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:42.198349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Resource SecurityGroupRule deleted: 7e934cb1-6b77-417f-aa18-1e563850e638 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:42.199202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7e934cb1-6b77-417f-aa18-1e563850e638), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:42.200169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:42.201325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Resource SecurityGroupRule deleted: c6f186a5-dc2e-4844-9645-30a51aa4d2e6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:42.202212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c6f186a5-dc2e-4844-9645-30a51aa4d2e6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:42.202623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-617ab5ff-1186-4159-9c0a-5fb910276276 admin admin] Security group rule updated ['fc3293bf-d1ef-4bfd-8975-0f5685c8629d'] Oct 16 01:04:43.362664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:458 started Oct 16 01:04:43.368865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f72,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=10000000,duration_sec=950,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:43.370207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:43.370817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 01:04:44.526285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9710d0f6-ec3f-477b-a915-9a26661b9c0e admin admin] Resource Port deleted: 3a245083-425c-44d7-b1c7-ff24d35e844e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:44.526885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9710d0f6-ec3f-477b-a915-9a26661b9c0e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (3a245083-425c-44d7-b1c7-ff24d35e844e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:45.364534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:459 started Oct 16 01:04:45.366998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f74,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=10000000,duration_sec=952,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:45.367589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:45.367935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:459 - starting polling. Elapsed:0.004 Oct 16 01:04:45.370743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:45.374327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3a245083-42, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:04:45.395412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f76,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:45.395988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['3a245083-425c-44d7-b1c7-ff24d35e844e'] Oct 16 01:04:45.396443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:04:45.461529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f075ebd-11d2-48be-a4dd-0f4a5994f653]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:04:45.465735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:459 - port information retrieved. Elapsed:0.102 Oct 16 01:04:45.466286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.102 Oct 16 01:04:45.922642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5730c008-7e69-47a6-b602-f44d5d07cd41 admin admin] Resource Port deleted: 71efdb3f-9c56-4a2c-8049-f6c1d0baa573 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:45.927252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5730c008-7e69-47a6-b602-f44d5d07cd41 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (71efdb3f-9c56-4a2c-8049-f6c1d0baa573), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:46.023098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c8aeca6e-c891-420a-a971-aafd622e65ab","delete","qr-3a245083-42",16,["map",[["attached-mac","fa:16:3e:c1:95:0e"],["iface-id","3a245083-425c-44d7-b1c7-ff24d35e844e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:04:46.400051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-de01be7e-3eb3-4c2f-a550-9602b90f69c4 admin admin] Resource Subnet deleted: ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:46.400638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-de01be7e-3eb3-4c2f-a550-9602b90f69c4 admin admin] Publish callbacks [] for Subnet (ceaa3f0f-5ce2-477a-b054-a1bf7c24f60d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:46.431901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["28ea11d4-4853-423d-b3ad-5cf75ed3a669","delete","qg-71efdb3f-9c",12,["map",[["attached-mac","fa:16:3e:00:91:af"],["iface-id","71efdb3f-9c56-4a2c-8049-f6c1d0baa573"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:04:46.546835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a2100145-5df0-4f84-91cb-e02f596985e3","delete","tap6e26ee91-59",10,["map",[["attached-mac","fa:16:3e:c8:15:e5"],["iface-id","6e26ee91-59c3-4584-bc74-1d8a09fa7ed5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:04:46.749594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fdb4136c-cbb9-4798-bbb2-d1f502f74366 admin admin] Resource Port deleted: 6e26ee91-59c3-4584-bc74-1d8a09fa7ed5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:46.750039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fdb4136c-cbb9-4798-bbb2-d1f502f74366 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (6e26ee91-59c3-4584-bc74-1d8a09fa7ed5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:46.997086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fdb4136c-cbb9-4798-bbb2-d1f502f74366 admin admin] Resource Network deleted: 758abdbd-543f-42fe-8aa7-53af6cbbeb5d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:46.997996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fdb4136c-cbb9-4798-bbb2-d1f502f74366 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (758abdbd-543f-42fe-8aa7-53af6cbbeb5d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.315812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Resource SecurityGroup deleted: 9236e40c-bc5b-4898-8dde-3af8e3c85f1b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:47.316345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (9236e40c-bc5b-4898-8dde-3af8e3c85f1b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.317502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9236e40c-bc5b-4898-8dde-3af8e3c85f1b',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:47.331589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9236e40c-bc5b-4898-8dde-3af8e3c85f1b',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:47.332152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Resource SecurityGroupRule deleted: 1cd8e9e9-9b21-4331-ac4e-a02b8b404fc0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:47.332557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1cd8e9e9-9b21-4331-ac4e-a02b8b404fc0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.332902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 01:04:47.333305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Resource SecurityGroupRule deleted: 7cb8d207-9e9e-4d1d-8642-6f325a70db66 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:47.333663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7cb8d207-9e9e-4d1d-8642-6f325a70db66), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.333990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 01:04:47.334883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Resource SecurityGroupRule deleted: 905b8bb3-ca57-4461-a65e-dbfcdab46837 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:47.335256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (905b8bb3-ca57-4461-a65e-dbfcdab46837), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.335582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 01:04:47.335966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Resource SecurityGroupRule deleted: aa74bd42-e66f-4249-9683-b22505e1b653 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:47.336318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (aa74bd42-e66f-4249-9683-b22505e1b653), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.336652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8c4f03e-5319-49ce-9ea5-c6297ea70ee5 admin admin] Security group rule updated ['9236e40c-bc5b-4898-8dde-3af8e3c85f1b'] Oct 16 01:04:47.364997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:460 started Oct 16 01:04:47.367758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f78,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=10000000,duration_sec=954,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:47.368380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:47.368870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:460 - starting polling. Elapsed:0.004 Oct 16 01:04:47.371430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:47.377744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f7a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:47.380071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f7c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:47.381758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416f7e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:47.382075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:460 - port information retrieved. Elapsed:0.017 Oct 16 01:04:47.382406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '48424f32-bbb0-49e2-95a3-c10004ab3ea6', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '3a245083-425c-44d7-b1c7-ff24d35e844e'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:04:47.382952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:460 - agent port security group processed in 0.000 Oct 16 01:04:47.385472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:04:47.385677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '3a245083-425c-44d7-b1c7-ff24d35e844e'} Oct 16 01:04:47.386092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3a245083-425c-44d7-b1c7-ff24d35e844e is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:04:47.386468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:04:47.436546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe24b21-1883-47f7-a6aa-edc377359f8c]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:04:47.437151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'6e26ee91-59c3-4584-bc74-1d8a09fa7ed5', '71efdb3f-9c56-4a2c-8049-f6c1d0baa573', '3a245083-425c-44d7-b1c7-ff24d35e844e'} removed Oct 16 01:04:47.507541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:04:47.508103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 7 from net-id = 758abdbd-543f-42fe-8aa7-53af6cbbeb5d, seg-id = 376 Oct 16 01:04:47.511248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8ca3,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:47.513608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416f80,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4472}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:47.514053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:04:47.514364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:460 - treat_devices_removed completed in 0.129 Oct 16 01:04:47.514660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:460 - ports processed. Elapsed:0.150 Oct 16 01:04:47.515038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.150 Oct 16 01:04:49.365646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:461 started Oct 16 01:04:49.368159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f82,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=11000000,duration_sec=956,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:49.368733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:49.369084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:50.652088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:50Z,description='Default security group',id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,is_default=True,name='default',project_id='290958d9e5034a9bb65cadd610860cc8',revision_number=1,rules=[SecurityGroupRule(018f2fde-b349-4994-8646-005c1f44e3db),SecurityGroupRule(3d3e4dbd-c1f4-4888-8457-387c0b11d7ed),SecurityGroupRule(97a44f1c-4adf-46d0-8d79-093ae73ff4ff),SecurityGroupRule(d5d80bfa-25b8-4764-9a5f-1c809cbaa913)],shared=False,stateful=True,updated_at=2022-10-16T01:04:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:50.652729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3b066723-f3fc-4aad-b1fb-50ba5c03b4ac), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.653303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:50Z,description=,direction='ingress',ethertype='IPv6',id=018f2fde-b349-4994-8646-005c1f44e3db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='290958d9e5034a9bb65cadd610860cc8',protocol=,remote_address_group_id=,remote_group_id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,remote_ip_prefix=,revision_number=0,security_group_id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,updated_at=2022-10-16T01:04:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:50.653672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (018f2fde-b349-4994-8646-005c1f44e3db), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.654014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.654704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:50Z,description=,direction='ingress',ethertype='IPv4',id=3d3e4dbd-c1f4-4888-8457-387c0b11d7ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='290958d9e5034a9bb65cadd610860cc8',protocol=,remote_address_group_id=,remote_group_id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,remote_ip_prefix=,revision_number=0,security_group_id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,updated_at=2022-10-16T01:04:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:50.655101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3d3e4dbd-c1f4-4888-8457-387c0b11d7ed), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.655436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.656099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:50Z,description=,direction='egress',ethertype='IPv6',id=97a44f1c-4adf-46d0-8d79-093ae73ff4ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='290958d9e5034a9bb65cadd610860cc8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,updated_at=2022-10-16T01:04:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:50.656485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (97a44f1c-4adf-46d0-8d79-093ae73ff4ff), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.656818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.657477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:50Z,description=,direction='egress',ethertype='IPv4',id=d5d80bfa-25b8-4764-9a5f-1c809cbaa913,normalized_cidr=None,port_range_max=,port_range_min=,project_id='290958d9e5034a9bb65cadd610860cc8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3b066723-f3fc-4aad-b1fb-50ba5c03b4ac,updated_at=2022-10-16T01:04:50Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:50.657832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d5d80bfa-25b8-4764-9a5f-1c809cbaa913), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.658179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1605d8a2-b94f-44f9-9267-c84fab755d52 admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.782706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Resource SecurityGroup deleted: 3b066723-f3fc-4aad-b1fb-50ba5c03b4ac {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:50.783115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3b066723-f3fc-4aad-b1fb-50ba5c03b4ac), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.783577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3b066723-f3fc-4aad-b1fb-50ba5c03b4ac',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:50.797592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3b066723-f3fc-4aad-b1fb-50ba5c03b4ac',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:50.798091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Resource SecurityGroupRule deleted: 018f2fde-b349-4994-8646-005c1f44e3db {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:50.798459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (018f2fde-b349-4994-8646-005c1f44e3db), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.798792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.799206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Resource SecurityGroupRule deleted: 3d3e4dbd-c1f4-4888-8457-387c0b11d7ed {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:50.799549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3d3e4dbd-c1f4-4888-8457-387c0b11d7ed), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.799869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.800238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Resource SecurityGroupRule deleted: 97a44f1c-4adf-46d0-8d79-093ae73ff4ff {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:50.800598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (97a44f1c-4adf-46d0-8d79-093ae73ff4ff), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.801687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:50.802123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Resource SecurityGroupRule deleted: d5d80bfa-25b8-4764-9a5f-1c809cbaa913 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:50.802471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d5d80bfa-25b8-4764-9a5f-1c809cbaa913), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:50.802790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-95c323e5-f80e-4045-b7da-faf92ec708ef admin admin] Security group rule updated ['3b066723-f3fc-4aad-b1fb-50ba5c03b4ac'] Oct 16 01:04:51.366370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:462 started Oct 16 01:04:51.369171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f84,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=12000000,duration_sec=958,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:51.369783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:51.370140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:53.367222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:463 started Oct 16 01:04:53.369636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f86,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=13000000,duration_sec=960,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:53.370240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:53.370608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:55.368782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:464 started Oct 16 01:04:55.371170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f88,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=14000000,duration_sec=962,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:55.371738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:55.372091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:55.941613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:04:55Z,description='Default security group',id=c9f400cd-a706-4a0f-a347-7a3db73178aa,is_default=True,name='default',project_id='8e285686fd0f4ef883fbbab3a24ace5f',revision_number=1,rules=[SecurityGroupRule(6a0a1ed0-e16b-4fc8-ab25-dadebfa45cef),SecurityGroupRule(735b033e-f6f6-4c64-bd98-2d8c42bd3b8f),SecurityGroupRule(8d8191da-c364-4755-aae2-65f14227493d),SecurityGroupRule(a86244af-6b5b-4c4a-81e3-989a8c58fc32)],shared=False,stateful=True,updated_at=2022-10-16T01:04:55Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:55.942031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (c9f400cd-a706-4a0f-a347-7a3db73178aa), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:55.942667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:55Z,description=,direction='egress',ethertype='IPv4',id=6a0a1ed0-e16b-4fc8-ab25-dadebfa45cef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e285686fd0f4ef883fbbab3a24ace5f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c9f400cd-a706-4a0f-a347-7a3db73178aa,updated_at=2022-10-16T01:04:55Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:55.943071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6a0a1ed0-e16b-4fc8-ab25-dadebfa45cef), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:55.943999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:55.944795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:55Z,description=,direction='ingress',ethertype='IPv4',id=735b033e-f6f6-4c64-bd98-2d8c42bd3b8f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e285686fd0f4ef883fbbab3a24ace5f',protocol=,remote_address_group_id=,remote_group_id=c9f400cd-a706-4a0f-a347-7a3db73178aa,remote_ip_prefix=,revision_number=0,security_group_id=c9f400cd-a706-4a0f-a347-7a3db73178aa,updated_at=2022-10-16T01:04:55Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:55.945164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (735b033e-f6f6-4c64-bd98-2d8c42bd3b8f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:55.945506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:55.946454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:55Z,description=,direction='egress',ethertype='IPv6',id=8d8191da-c364-4755-aae2-65f14227493d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e285686fd0f4ef883fbbab3a24ace5f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c9f400cd-a706-4a0f-a347-7a3db73178aa,updated_at=2022-10-16T01:04:55Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:55.946847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8d8191da-c364-4755-aae2-65f14227493d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:55.947203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:55.947874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:04:55Z,description=,direction='ingress',ethertype='IPv6',id=a86244af-6b5b-4c4a-81e3-989a8c58fc32,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e285686fd0f4ef883fbbab3a24ace5f',protocol=,remote_address_group_id=,remote_group_id=c9f400cd-a706-4a0f-a347-7a3db73178aa,remote_ip_prefix=,revision_number=0,security_group_id=c9f400cd-a706-4a0f-a347-7a3db73178aa,updated_at=2022-10-16T01:04:55Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:04:55.948240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (a86244af-6b5b-4c4a-81e3-989a8c58fc32), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:55.948573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b7ab36b9-b529-4a1a-8a28-21da3975e5bd admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:56.074757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Resource SecurityGroup deleted: c9f400cd-a706-4a0f-a347-7a3db73178aa {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:56.075278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (c9f400cd-a706-4a0f-a347-7a3db73178aa), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:56.075944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c9f400cd-a706-4a0f-a347-7a3db73178aa',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:04:56.090387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c9f400cd-a706-4a0f-a347-7a3db73178aa',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:04:56.091021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Resource SecurityGroupRule deleted: 6a0a1ed0-e16b-4fc8-ab25-dadebfa45cef {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:56.091288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6a0a1ed0-e16b-4fc8-ab25-dadebfa45cef), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:56.091631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:56.092029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Resource SecurityGroupRule deleted: 735b033e-f6f6-4c64-bd98-2d8c42bd3b8f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:56.092383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (735b033e-f6f6-4c64-bd98-2d8c42bd3b8f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:56.092708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:56.093092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Resource SecurityGroupRule deleted: 8d8191da-c364-4755-aae2-65f14227493d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:56.093443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8d8191da-c364-4755-aae2-65f14227493d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:56.093767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:56.094141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Resource SecurityGroupRule deleted: a86244af-6b5b-4c4a-81e3-989a8c58fc32 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:04:56.094485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a86244af-6b5b-4c4a-81e3-989a8c58fc32), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:04:56.094808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-db2850b1-dd12-4602-abc9-2ee52451b439 admin admin] Security group rule updated ['c9f400cd-a706-4a0f-a347-7a3db73178aa'] Oct 16 01:04:57.369999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:465 started Oct 16 01:04:57.372868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f8a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=16000000,duration_sec=964,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:57.373457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:57.373813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:04:59.371174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:466 started Oct 16 01:04:59.373533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f8c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=17000000,duration_sec=966,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:04:59.374105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:04:59.374457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:01.372150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:467 started Oct 16 01:05:01.374555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f8e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=18000000,duration_sec=968,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:01.375150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:01.375497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:03.373662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:468 started Oct 16 01:05:03.376351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f90,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=19000000,duration_sec=970,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:03.376957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:03.377411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:05.374231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:469 started Oct 16 01:05:05.376733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f92,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=20000000,duration_sec=972,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:05.377304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:05.377869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:07.375569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:470 started Oct 16 01:05:07.377949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f94,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=21000000,duration_sec=974,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:07.378521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:07.378906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:09.376928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:471 started Oct 16 01:05:09.379440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f96,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=22000000,duration_sec=976,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:09.380009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:09.380365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:11.377530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:472 started Oct 16 01:05:11.379998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f98,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=23000000,duration_sec=978,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:11.380590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:11.380944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:13.378372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:473 started Oct 16 01:05:13.380779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f9a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=24000000,duration_sec=980,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:13.381383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:13.381742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:15.379254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:474 started Oct 16 01:05:15.381659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f9c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=25000000,duration_sec=982,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:15.382229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:15.382636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:17.380162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:475 started Oct 16 01:05:17.382616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416f9e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=26000000,duration_sec=984,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:17.383304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:17.383664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:19.381515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:476 started Oct 16 01:05:19.384893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fa0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=28000000,duration_sec=986,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:19.385469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:19.385829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:05:21.382330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:477 started Oct 16 01:05:21.384774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fa2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=28000000,duration_sec=988,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:21.385350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:21.385712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:23.383129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:478 started Oct 16 01:05:23.385846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fa4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=29000000,duration_sec=990,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:23.386422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:23.386783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:25.384111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:479 started Oct 16 01:05:25.386634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fa6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=29000000,duration_sec=992,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:25.387236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:25.387605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:27.385495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:480 started Oct 16 01:05:27.387940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fa8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=31000000,duration_sec=994,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:27.388520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:27.388908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:28.240818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-69410d61-c04f-47f4-b0bf-a1aa2df7fcb5 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource Port deleted: 3f07f60b-d2b6-4758-8e13-af7cb046e538 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:28.241204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-69410d61-c04f-47f4-b0bf-a1aa2df7fcb5 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (3f07f60b-d2b6-4758-8e13-af7cb046e538), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:29.386583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:481 started Oct 16 01:05:29.390352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416faa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=33000000,duration_sec=996,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:29.390989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:29.391358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:481 - starting polling. Elapsed:0.005 Oct 16 01:05:29.393886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:29.395634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3f07f60b-d2b6-4758-8e13-af7cb046e538 not present in bridge br-int Oct 16 01:05:29.396623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:05:29.396923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['3f07f60b-d2b6-4758-8e13-af7cb046e538'] Oct 16 01:05:29.397277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 3f07f60b-d2b6-4758-8e13-af7cb046e538 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:05:29.401385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:481 - port information retrieved. Elapsed:0.015 Oct 16 01:05:29.401729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Oct 16 01:05:31.387295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:482 started Oct 16 01:05:31.390304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=33000000,duration_sec=998,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:31.390991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:31.391477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:32.274497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-44ba4fb5-9c9c-431f-be12-82b7f6e75228 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource Port deleted: a16383c6-9bce-4108-ad57-fad77bb41e2b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:32.274983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-44ba4fb5-9c9c-431f-be12-82b7f6e75228 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (a16383c6-9bce-4108-ad57-fad77bb41e2b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:32.275470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-44ba4fb5-9c9c-431f-be12-82b7f6e75228 tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group member updated {'0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'} Oct 16 01:05:33.388432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:483 started Oct 16 01:05:33.390969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=34000000,duration_sec=1000,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:33.391557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:33.391904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:483 - starting polling. Elapsed:0.004 Oct 16 01:05:33.394424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:33.396202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a16383c6-9bce-4108-ad57-fad77bb41e2b not present in bridge br-int Oct 16 01:05:33.396677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:05:33.396979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['a16383c6-9bce-4108-ad57-fad77bb41e2b'] Oct 16 01:05:33.397362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a16383c6-9bce-4108-ad57-fad77bb41e2b is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:05:33.400840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:483 - port information retrieved. Elapsed:0.013 Oct 16 01:05:33.401185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:05:35.389664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:484 started Oct 16 01:05:35.392207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fb0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=35000000,duration_sec=1002,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:35.392790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:35.393154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:37.390202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:485 started Oct 16 01:05:37.394279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fb2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=36000000,duration_sec=1004,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:37.396019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:37.396712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 01:05:38.797446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroup deleted: 0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.798601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.799415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:38.831738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:38.834277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: 122170a8-01fe-4f53-abad-fd1d0871e67b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.834798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (122170a8-01fe-4f53-abad-fd1d0871e67b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.835489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.836112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: d7e770de-4791-4d72-8f2f-7653192154b5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.836719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d7e770de-4791-4d72-8f2f-7653192154b5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.837333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.837631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: e5be585f-9b97-4c38-ad6e-5ddf224e1215 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.838109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e5be585f-9b97-4c38-ad6e-5ddf224e1215), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.839117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.840281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: e60bc609-7163-4b8d-88f8-a9ea1294e0ce {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.840742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e60bc609-7163-4b8d-88f8-a9ea1294e0ce), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.841167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.841657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: 5189b162-4a82-4891-87a7-b35068dbec39 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.842248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5189b162-4a82-4891-87a7-b35068dbec39), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.842806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.843355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: ed1924ea-fae9-4dbe-bafa-55edb14c619b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.843871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ed1924ea-fae9-4dbe-bafa-55edb14c619b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.844197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.844581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: a2847e34-a9d7-4715-80b2-87efcd94e5b1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.844930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (a2847e34-a9d7-4715-80b2-87efcd94e5b1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.845250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:38.845823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Resource SecurityGroupRule deleted: 31185fc2-c566-4621-ad7c-4714b1692950 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:38.846177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (31185fc2-c566-4621-ad7c-4714b1692950), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:38.846497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee145b80-2caf-4bee-bc5d-c7aeecf7e8bd tempest-TestShelveInstance-628145774 tempest-TestShelveInstance-628145774-project] Security group rule updated ['0c2a3776-7ed3-40a4-b2cb-b0c7690cecf9'] Oct 16 01:05:39.396765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:486 started Oct 16 01:05:39.396765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fb4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=37000000,duration_sec=1006,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:39.396765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:39.396765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:39.955405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6aa69034-a3bb-4530-b05d-2524759092c4 admin admin] Resource Port deleted: 48424f32-bbb0-49e2-95a3-c10004ab3ea6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:39.956076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6aa69034-a3bb-4530-b05d-2524759092c4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (48424f32-bbb0-49e2-95a3-c10004ab3ea6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.202947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:41Z,description='Default security group',id=4f810647-aafa-466d-ad2a-9f13b1a704ba,is_default=True,name='default',project_id='8e94f3bfc3fb40c2abec795f711611f3',revision_number=1,rules=[SecurityGroupRule(9d46bc41-9cb7-4eff-972c-b9c812dec500),SecurityGroupRule(9f8b344c-57ce-4c28-8941-4557fd23f43b),SecurityGroupRule(b5c27cb1-8333-4124-b8ac-fc8980517b63),SecurityGroupRule(e569119b-a8c2-45df-98e5-3ce353b1446c)],shared=False,stateful=True,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:41.203624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (4f810647-aafa-466d-ad2a-9f13b1a704ba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.203973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='ingress',ethertype='IPv6',id=9d46bc41-9cb7-4eff-972c-b9c812dec500,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e94f3bfc3fb40c2abec795f711611f3',protocol=,remote_address_group_id=,remote_group_id=4f810647-aafa-466d-ad2a-9f13b1a704ba,remote_ip_prefix=,revision_number=0,security_group_id=4f810647-aafa-466d-ad2a-9f13b1a704ba,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:41.204343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9d46bc41-9cb7-4eff-972c-b9c812dec500), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.204681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.205550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='egress',ethertype='IPv6',id=9f8b344c-57ce-4c28-8941-4557fd23f43b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e94f3bfc3fb40c2abec795f711611f3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4f810647-aafa-466d-ad2a-9f13b1a704ba,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:41.206094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9f8b344c-57ce-4c28-8941-4557fd23f43b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.206603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.207491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='egress',ethertype='IPv4',id=b5c27cb1-8333-4124-b8ac-fc8980517b63,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e94f3bfc3fb40c2abec795f711611f3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4f810647-aafa-466d-ad2a-9f13b1a704ba,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:41.208048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b5c27cb1-8333-4124-b8ac-fc8980517b63), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.208562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.210660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='ingress',ethertype='IPv4',id=e569119b-a8c2-45df-98e5-3ce353b1446c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e94f3bfc3fb40c2abec795f711611f3',protocol=,remote_address_group_id=,remote_group_id=4f810647-aafa-466d-ad2a-9f13b1a704ba,remote_ip_prefix=,revision_number=0,security_group_id=4f810647-aafa-466d-ad2a-9f13b1a704ba,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:41.218028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e569119b-a8c2-45df-98e5-3ce353b1446c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.218711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4f3a417b-d134-4511-b9ba-f39b4dc07669 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.309866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-55e67f32-bed8-4db7-a391-a0483faf3389 admin admin] Resource Port deleted: ad486221-b874-47bb-a0e9-8f586fd9fc56 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:41.310255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-55e67f32-bed8-4db7-a391-a0483faf3389 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (ad486221-b874-47bb-a0e9-8f586fd9fc56), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.343437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["02f7c04c-bb64-42d6-9495-558c4ff7acf6","delete","qr-48424f32-bb",26,["map",[["attached-mac","fa:16:3e:b9:96:fa"],["iface-id","48424f32-bbb0-49e2-95a3-c10004ab3ea6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:05:41.392191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:487 started Oct 16 01:05:41.423509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Resource SecurityGroup deleted: 4f810647-aafa-466d-ad2a-9f13b1a704ba {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:41.424141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (4f810647-aafa-466d-ad2a-9f13b1a704ba), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.424797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4f810647-aafa-466d-ad2a-9f13b1a704ba',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:41.442301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4f810647-aafa-466d-ad2a-9f13b1a704ba',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:41.442795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Resource SecurityGroupRule deleted: 9d46bc41-9cb7-4eff-972c-b9c812dec500 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:41.443211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9d46bc41-9cb7-4eff-972c-b9c812dec500), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.443559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.444673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Resource SecurityGroupRule deleted: 9f8b344c-57ce-4c28-8941-4557fd23f43b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:41.445040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9f8b344c-57ce-4c28-8941-4557fd23f43b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.445371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.446015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Resource SecurityGroupRule deleted: b5c27cb1-8333-4124-b8ac-fc8980517b63 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:41.446366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b5c27cb1-8333-4124-b8ac-fc8980517b63), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.446693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.447093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Resource SecurityGroupRule deleted: e569119b-a8c2-45df-98e5-3ce353b1446c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:41.447445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e569119b-a8c2-45df-98e5-3ce353b1446c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.447770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-15001526-add3-4881-99f5-8980a4f6e3d2 admin admin] Security group rule updated ['4f810647-aafa-466d-ad2a-9f13b1a704ba'] Oct 16 01:05:41.651923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fb6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=281000000,duration_sec=1008,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:41.655723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:41.656498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:487 - starting polling. Elapsed:0.264 Oct 16 01:05:41.659896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:41.675688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-ad486221-b8, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:05:41.705621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fb8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:41.705750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['ad486221-b874-47bb-a0e9-8f586fd9fc56'] Oct 16 01:05:41.706110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:05:41.775077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa70db1-1853-4c7a-bdcf-442e2821b71f]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:05:41.783117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fba,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:41.783351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:487 - port information retrieved. Elapsed:0.391 Oct 16 01:05:41.783681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', 'ae7a598c-abda-4719-a81e-669ce56a67f1', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', 'ad486221-b874-47bb-a0e9-8f586fd9fc56', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'48424f32-bbb0-49e2-95a3-c10004ab3ea6'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:05:41.784070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:487 - agent port security group processed in 0.000 Oct 16 01:05:41.786650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:05:41.787001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'48424f32-bbb0-49e2-95a3-c10004ab3ea6'} Oct 16 01:05:41.787444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:05:41.847184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a271a8-eead-4158-a04f-471d407c68e2]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:05:41.848183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'48424f32-bbb0-49e2-95a3-c10004ab3ea6'} removed Oct 16 01:05:41.853445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a756e804-ce3f-4ba3-b604-495add8660be","delete","qg-ad486221-b8",25,["map",[["attached-mac","fa:16:3e:e7:0d:04"],["iface-id","ad486221-b874-47bb-a0e9-8f586fd9fc56"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:05:41.882348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:05:41.882884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:487 - treat_devices_removed completed in 0.096 Oct 16 01:05:41.883324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:487 - ports processed. Elapsed:0.491 Oct 16 01:05:41.883671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.492 Oct 16 01:05:41.999273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:41Z,description='Default security group',id=5a2002c8-6c95-40df-9d0d-731114cde002,is_default=True,name='default',project_id='47566c37dcde4c4fb5fc1998590a3819',revision_number=1,rules=[SecurityGroupRule(57222d70-53c0-4814-8698-bc3f3ef9102e),SecurityGroupRule(58988a74-7194-4bbd-906d-24b728bc0eaf),SecurityGroupRule(d88619ee-31a7-4c2a-9db1-91d2534b54d0),SecurityGroupRule(ded0f7f0-31e5-4939-ae46-26acfc7a1cd4)],shared=False,stateful=True,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:41.999696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (5a2002c8-6c95-40df-9d0d-731114cde002), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.000687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='ingress',ethertype='IPv4',id=57222d70-53c0-4814-8698-bc3f3ef9102e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47566c37dcde4c4fb5fc1998590a3819',protocol=,remote_address_group_id=,remote_group_id=5a2002c8-6c95-40df-9d0d-731114cde002,remote_ip_prefix=,revision_number=0,security_group_id=5a2002c8-6c95-40df-9d0d-731114cde002,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:42.001158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (57222d70-53c0-4814-8698-bc3f3ef9102e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.001561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.002245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='egress',ethertype='IPv6',id=58988a74-7194-4bbd-906d-24b728bc0eaf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47566c37dcde4c4fb5fc1998590a3819',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5a2002c8-6c95-40df-9d0d-731114cde002,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:42.002801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (58988a74-7194-4bbd-906d-24b728bc0eaf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.003329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.004006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='ingress',ethertype='IPv6',id=d88619ee-31a7-4c2a-9db1-91d2534b54d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47566c37dcde4c4fb5fc1998590a3819',protocol=,remote_address_group_id=,remote_group_id=5a2002c8-6c95-40df-9d0d-731114cde002,remote_ip_prefix=,revision_number=0,security_group_id=5a2002c8-6c95-40df-9d0d-731114cde002,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:42.004825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d88619ee-31a7-4c2a-9db1-91d2534b54d0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.004825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.005353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:41Z,description=,direction='egress',ethertype='IPv4',id=ded0f7f0-31e5-4939-ae46-26acfc7a1cd4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47566c37dcde4c4fb5fc1998590a3819',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5a2002c8-6c95-40df-9d0d-731114cde002,updated_at=2022-10-16T01:05:41Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:42.005711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ded0f7f0-31e5-4939-ae46-26acfc7a1cd4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.006044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-57d27adc-57f4-4880-ad71-07f4f4bdc253 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.356327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5234884f-6a45-4068-b67e-25a9f4f92bf2 admin admin] Resource Subnet deleted: de2290f6-6368-4cf5-9301-7df9595cdb2f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:42.356905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5234884f-6a45-4068-b67e-25a9f4f92bf2 admin admin] Publish callbacks [] for Subnet (de2290f6-6368-4cf5-9301-7df9595cdb2f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.364797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Resource SecurityGroup deleted: 5a2002c8-6c95-40df-9d0d-731114cde002 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:42.365402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (5a2002c8-6c95-40df-9d0d-731114cde002), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.366687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5a2002c8-6c95-40df-9d0d-731114cde002',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:42.447787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5a2002c8-6c95-40df-9d0d-731114cde002',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:42.448405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Resource SecurityGroupRule deleted: 57222d70-53c0-4814-8698-bc3f3ef9102e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:42.448994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (57222d70-53c0-4814-8698-bc3f3ef9102e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.449331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.449725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Resource SecurityGroupRule deleted: 58988a74-7194-4bbd-906d-24b728bc0eaf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:42.450070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (58988a74-7194-4bbd-906d-24b728bc0eaf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.450391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.450762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Resource SecurityGroupRule deleted: d88619ee-31a7-4c2a-9db1-91d2534b54d0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:42.451128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d88619ee-31a7-4c2a-9db1-91d2534b54d0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.451445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.451810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Resource SecurityGroupRule deleted: ded0f7f0-31e5-4939-ae46-26acfc7a1cd4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:42.452147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ded0f7f0-31e5-4939-ae46-26acfc7a1cd4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:42.452477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-89535bfa-2368-4959-a683-702772fb63f3 admin admin] Security group rule updated ['5a2002c8-6c95-40df-9d0d-731114cde002'] Oct 16 01:05:42.541628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0790d68f-a0cc-4169-801b-6920aa1e4969","delete","tapae7a598c-ab",24,["map",[["attached-mac","fa:16:3e:f0:7d:26"],["iface-id","ae7a598c-abda-4719-a81e-669ce56a67f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:05:43.063940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a23272c2-5995-487f-b3b1-4353d449cdc4 admin admin] Resource Port deleted: ae7a598c-abda-4719-a81e-669ce56a67f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:43.064848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a23272c2-5995-487f-b3b1-4353d449cdc4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (ae7a598c-abda-4719-a81e-669ce56a67f1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:43.160598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8d32ee80-d671-4125-842c-741bb657012b None None] Resource Port deleted: ae7a598c-abda-4719-a81e-669ce56a67f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:43.161283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8d32ee80-d671-4125-842c-741bb657012b None None] Skipped duplicate delete event for ae7a598c-abda-4719-a81e-669ce56a67f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 01:05:43.393074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:488 started Oct 16 01:05:43.399620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fbc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=41000000,duration_sec=1010,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:43.400218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:43.400741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:488 - starting polling. Elapsed:0.008 Oct 16 01:05:43.403069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:43.410339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fbe,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:43.414268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fc0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:43.414853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:488 - port information retrieved. Elapsed:0.022 Oct 16 01:05:43.414853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', '199a6a07-ef81-454a-9a90-e16388fd8068', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '02def970-29eb-4148-a20d-445ed75d4fe8', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'ae7a598c-abda-4719-a81e-669ce56a67f1'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:05:43.415982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:488 - agent port security group processed in 0.000 Oct 16 01:05:43.418053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:05:43.418361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'ae7a598c-abda-4719-a81e-669ce56a67f1'} Oct 16 01:05:43.418696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ad486221-b874-47bb-a0e9-8f586fd9fc56 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:05:43.419157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:05:43.485751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef368f-27d0-4b98-a1aa-098fbac6efbf]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:05:43.488482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'ad486221-b874-47bb-a0e9-8f586fd9fc56', 'ae7a598c-abda-4719-a81e-669ce56a67f1'} removed Oct 16 01:05:43.490511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a23272c2-5995-487f-b3b1-4353d449cdc4 admin admin] Resource Network deleted: aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:43.491098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a23272c2-5995-487f-b3b1-4353d449cdc4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:43.538993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:05:43.539927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:05:43.540330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 10 from net-id = aa50a2c7-3d8b-4cfc-9637-4222e01ba9ae, seg-id = 350 Oct 16 01:05:43.542994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8ca5,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:43.546023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416fc2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4446}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:43.546555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:488 - treat_devices_removed completed in 0.128 Oct 16 01:05:43.547196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:488 - ports processed. Elapsed:0.154 Oct 16 01:05:43.547687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.155 Oct 16 01:05:45.394162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:489 started Oct 16 01:05:45.397532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fc4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=40000000,duration_sec=1012,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:45.398505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:45.399156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:05:45.720937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:45Z,description='Default security group',id=217cdaad-fde7-4068-8925-df83b59f70ef,is_default=True,name='default',project_id='87768236a9914eb7bb447042a07166ce',revision_number=1,rules=[SecurityGroupRule(03986b74-1ff9-46a8-83aa-a9da4866d075),SecurityGroupRule(1fa7f8f9-8628-4f23-9dea-879d6a0183f8),SecurityGroupRule(47ccdc84-f30c-4a47-8b7c-0bfca32f739f),SecurityGroupRule(ae5dd6ca-e44a-442b-98c5-53754b023c6d)],shared=False,stateful=True,updated_at=2022-10-16T01:05:45Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:45.721343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (217cdaad-fde7-4068-8925-df83b59f70ef), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.722193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:45Z,description=,direction='ingress',ethertype='IPv6',id=03986b74-1ff9-46a8-83aa-a9da4866d075,normalized_cidr=None,port_range_max=,port_range_min=,project_id='87768236a9914eb7bb447042a07166ce',protocol=,remote_address_group_id=,remote_group_id=217cdaad-fde7-4068-8925-df83b59f70ef,remote_ip_prefix=,revision_number=0,security_group_id=217cdaad-fde7-4068-8925-df83b59f70ef,updated_at=2022-10-16T01:05:45Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:45.722580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (03986b74-1ff9-46a8-83aa-a9da4866d075), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.722988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.723772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:45Z,description=,direction='ingress',ethertype='IPv4',id=1fa7f8f9-8628-4f23-9dea-879d6a0183f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='87768236a9914eb7bb447042a07166ce',protocol=,remote_address_group_id=,remote_group_id=217cdaad-fde7-4068-8925-df83b59f70ef,remote_ip_prefix=,revision_number=0,security_group_id=217cdaad-fde7-4068-8925-df83b59f70ef,updated_at=2022-10-16T01:05:45Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:45.724150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1fa7f8f9-8628-4f23-9dea-879d6a0183f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.724495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.726031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:45Z,description=,direction='egress',ethertype='IPv4',id=47ccdc84-f30c-4a47-8b7c-0bfca32f739f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='87768236a9914eb7bb447042a07166ce',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=217cdaad-fde7-4068-8925-df83b59f70ef,updated_at=2022-10-16T01:05:45Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:45.726820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (47ccdc84-f30c-4a47-8b7c-0bfca32f739f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.727380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.728270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:45Z,description=,direction='egress',ethertype='IPv6',id=ae5dd6ca-e44a-442b-98c5-53754b023c6d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='87768236a9914eb7bb447042a07166ce',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=217cdaad-fde7-4068-8925-df83b59f70ef,updated_at=2022-10-16T01:05:45Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:45.728820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ae5dd6ca-e44a-442b-98c5-53754b023c6d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.729347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-7714341a-bb07-458c-b44e-22253436f78b admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.747651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-67ef488a-bed3-45ec-9200-7a6490383311 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:05:44Z,data_plane_status=None,description='',device_id='7479d976-4c68-4862-8245-79dfaccf0f81',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8650d000-9eba-4333-85df-35ab0580d9c1,mac_address=fa:16:3e:ab:df:14,name='',network_id=67400858-429f-4052-a9a5-3012690406d5,numa_affinity_policy=,project_id='cb1743385ea14cc39244c83e8fc88e7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8650d000-9eba-4333-85df-35ab0580d9c1),security_group_ids=set([04a6f405-fb32-4245-a68e-14ecec65861c]),status='DOWN',updated_at=2022-10-16T01:05:44Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:45.748339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-67ef488a-bed3-45ec-9200-7a6490383311 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (8650d000-9eba-4333-85df-35ab0580d9c1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.749005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-67ef488a-bed3-45ec-9200-7a6490383311 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group member updated {'04a6f405-fb32-4245-a68e-14ecec65861c'} Oct 16 01:05:45.848518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-07c93286-103b-4ce1-ad36-da0b4b981fd6 admin admin] Resource Port deleted: 02def970-29eb-4148-a20d-445ed75d4fe8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:45.848975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-07c93286-103b-4ce1-ad36-da0b4b981fd6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (02def970-29eb-4148-a20d-445ed75d4fe8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.931642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Resource SecurityGroup deleted: 217cdaad-fde7-4068-8925-df83b59f70ef {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:45.932499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (217cdaad-fde7-4068-8925-df83b59f70ef), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.933051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('217cdaad-fde7-4068-8925-df83b59f70ef',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:45.960644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('217cdaad-fde7-4068-8925-df83b59f70ef',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:45.961128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Resource SecurityGroupRule deleted: 03986b74-1ff9-46a8-83aa-a9da4866d075 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:45.961686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (03986b74-1ff9-46a8-83aa-a9da4866d075), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.962268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.962831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Resource SecurityGroupRule deleted: 1fa7f8f9-8628-4f23-9dea-879d6a0183f8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:45.964370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1fa7f8f9-8628-4f23-9dea-879d6a0183f8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.964867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.965580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Resource SecurityGroupRule deleted: 47ccdc84-f30c-4a47-8b7c-0bfca32f739f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:45.966093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (47ccdc84-f30c-4a47-8b7c-0bfca32f739f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.966596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:45.971408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Resource SecurityGroupRule deleted: ae5dd6ca-e44a-442b-98c5-53754b023c6d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:45.972211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ae5dd6ca-e44a-442b-98c5-53754b023c6d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:45.972710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ad67e19f-e8c8-491d-a4f6-5fcbaf29fbc9 admin admin] Security group rule updated ['217cdaad-fde7-4068-8925-df83b59f70ef'] Oct 16 01:05:46.766258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ec6bf140-4583-42f7-b634-37ace50f10a9 service neutron] Resource Port 8650d000-9eba-4333-85df-35ab0580d9c1 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=8650d000-9eba-4333-85df-35ab0580d9c1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=8650d000-9eba-4333-85df-35ab0580d9c1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:05:46.767714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ec6bf140-4583-42f7-b634-37ace50f10a9 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (8650d000-9eba-4333-85df-35ab0580d9c1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:46.823154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:46Z,description='Default security group',id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,is_default=True,name='default',project_id='351ccc8517e14e84960b4b8b00d614ff',revision_number=1,rules=[SecurityGroupRule(9a7d8cd9-9d9c-40a9-a1ec-3e62eab5eb32),SecurityGroupRule(9c1b055e-c184-4fbe-a491-1550f1a792c2),SecurityGroupRule(c36b468b-97cf-4229-a040-53f903d94c89),SecurityGroupRule(f80a323d-320d-458c-b311-06d0c3e50f0e)],shared=False,stateful=True,updated_at=2022-10-16T01:05:46Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:46.823642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (9a5989cd-0d1a-4b8d-83c1-14835b06dcc6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:46.829311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:46Z,description=,direction='ingress',ethertype='IPv6',id=9a7d8cd9-9d9c-40a9-a1ec-3e62eab5eb32,normalized_cidr=None,port_range_max=,port_range_min=,project_id='351ccc8517e14e84960b4b8b00d614ff',protocol=,remote_address_group_id=,remote_group_id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,remote_ip_prefix=,revision_number=0,security_group_id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,updated_at=2022-10-16T01:05:46Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:46.829912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9a7d8cd9-9d9c-40a9-a1ec-3e62eab5eb32), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:46.830478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:46.831422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:46Z,description=,direction='egress',ethertype='IPv4',id=9c1b055e-c184-4fbe-a491-1550f1a792c2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='351ccc8517e14e84960b4b8b00d614ff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,updated_at=2022-10-16T01:05:46Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:46.836044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9c1b055e-c184-4fbe-a491-1550f1a792c2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:46.836689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:46.837675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:46Z,description=,direction='egress',ethertype='IPv6',id=c36b468b-97cf-4229-a040-53f903d94c89,normalized_cidr=None,port_range_max=,port_range_min=,project_id='351ccc8517e14e84960b4b8b00d614ff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,updated_at=2022-10-16T01:05:46Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:46.838278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c36b468b-97cf-4229-a040-53f903d94c89), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:46.838908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:46.839845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:46Z,description=,direction='ingress',ethertype='IPv4',id=f80a323d-320d-458c-b311-06d0c3e50f0e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='351ccc8517e14e84960b4b8b00d614ff',protocol=,remote_address_group_id=,remote_group_id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,remote_ip_prefix=,revision_number=0,security_group_id=9a5989cd-0d1a-4b8d-83c1-14835b06dcc6,updated_at=2022-10-16T01:05:46Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:46.840434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f80a323d-320d-458c-b311-06d0c3e50f0e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:46.840981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d94c7a05-8e6c-4f11-8a6a-e47c99ce7ea0 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:47.024506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Resource SecurityGroup deleted: 9a5989cd-0d1a-4b8d-83c1-14835b06dcc6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:47.025843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (9a5989cd-0d1a-4b8d-83c1-14835b06dcc6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.027197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9a5989cd-0d1a-4b8d-83c1-14835b06dcc6',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:47.051207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9a5989cd-0d1a-4b8d-83c1-14835b06dcc6',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:47.056194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Resource SecurityGroupRule deleted: 9a7d8cd9-9d9c-40a9-a1ec-3e62eab5eb32 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:47.056678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9a7d8cd9-9d9c-40a9-a1ec-3e62eab5eb32), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.057184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:47.057798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Resource SecurityGroupRule deleted: 9c1b055e-c184-4fbe-a491-1550f1a792c2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:47.058165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9c1b055e-c184-4fbe-a491-1550f1a792c2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.058497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:47.059450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Resource SecurityGroupRule deleted: c36b468b-97cf-4229-a040-53f903d94c89 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:47.059998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c36b468b-97cf-4229-a040-53f903d94c89), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.060543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:47.061118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Resource SecurityGroupRule deleted: f80a323d-320d-458c-b311-06d0c3e50f0e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:47.062989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f80a323d-320d-458c-b311-06d0c3e50f0e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.063714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d0cf7bb6-c320-434e-bc4c-e90b2aeb1f11 admin admin] Security group rule updated ['9a5989cd-0d1a-4b8d-83c1-14835b06dcc6'] Oct 16 01:05:47.395537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:490 started Oct 16 01:05:47.398703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fc6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=42000000,duration_sec=1014,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:47.399656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:47.400193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:490 - starting polling. Elapsed:0.005 Oct 16 01:05:47.402711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.406553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-02def970-29, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:05:47.423468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fc8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:47.425083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['02def970-29eb-4148-a20d-445ed75d4fe8'] Oct 16 01:05:47.425733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:05:47.503613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e17dcb6-87a9-45f2-b175-416f884dc578]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:05:47.512005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:490 - port information retrieved. Elapsed:0.117 Oct 16 01:05:47.512601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.117 Oct 16 01:05:47.573085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ec6bf140-4583-42f7-b634-37ace50f10a9 service neutron] Resource Port 8650d000-9eba-4333-85df-35ab0580d9c1 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=8650d000-9eba-4333-85df-35ab0580d9c1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=8650d000-9eba-4333-85df-35ab0580d9c1,segment=NetworkSegment(e85c3ee2-f8b6-42c0-8def-930e36cc19ac),segment_id=e85c3ee2-f8b6-42c0-8def-930e36cc19ac)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=8650d000-9eba-4333-85df-35ab0580d9c1,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:05:47.573601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ec6bf140-4583-42f7-b634-37ace50f10a9 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (8650d000-9eba-4333-85df-35ab0580d9c1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:47.750143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9360f9f2-489e-4fef-b95f-d937e35dfc65","delete","qr-02def970-29",29,["map",[["attached-mac","fa:16:3e:c3:6f:49"],["iface-id","02def970-29eb-4148-a20d-445ed75d4fe8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:05:48.198410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7b00fca6-df18-439d-9ce8-6b81fa6135b3","delete","qg-199a6a07-ef",28,["map",[["attached-mac","fa:16:3e:86:96:7b"],["iface-id","199a6a07-ef81-454a-9a90-e16388fd8068"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:05:48.205476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a142231b-3e7c-4081-833f-b2dafbdbc955 admin admin] Resource Port deleted: 199a6a07-ef81-454a-9a90-e16388fd8068 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:48.206286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a142231b-3e7c-4081-833f-b2dafbdbc955 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (199a6a07-ef81-454a-9a90-e16388fd8068), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:48.986071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4336a648-e362-49f5-9ab0-780c8c3c0903 admin admin] Resource Subnet deleted: de7a33c4-ae37-49e1-aede-5b4993e82cff {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:48.986640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4336a648-e362-49f5-9ab0-780c8c3c0903 admin admin] Publish callbacks [] for Subnet (de7a33c4-ae37-49e1-aede-5b4993e82cff), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:49.182030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5914fe85-8f90-45af-a09b-af9e152ae5fb","delete","tapc9bf46df-7a",27,["map",[["attached-mac","fa:16:3e:db:40:ee"],["iface-id","c9bf46df-7ac4-440c-8c35-1671b8a9814d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:05:49.397438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:491 started Oct 16 01:05:49.409289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=52000000,duration_sec=1016,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:49.410749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:49.411303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:491 - starting polling. Elapsed:0.015 Oct 16 01:05:49.414887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:49.432201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c325d99-2a24-489e-9597-1b6a7b0fb5f5 admin admin] Resource Port deleted: c9bf46df-7ac4-440c-8c35-1671b8a9814d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:49.432593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c325d99-2a24-489e-9597-1b6a7b0fb5f5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (c9bf46df-7ac4-440c-8c35-1671b8a9814d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:49.436130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fcc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:49.440103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fce,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:49.443220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79416fd0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:49.444278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:491 - port information retrieved. Elapsed:0.047 Oct 16 01:05:49.444630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', 'd6141001-454c-4247-9f8c-c8bedfbcc602', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '4499fdb3-16a3-4c5e-94f1-07baf827edcb', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'02def970-29eb-4148-a20d-445ed75d4fe8', '199a6a07-ef81-454a-9a90-e16388fd8068', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:05:49.445273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:491 - agent port security group processed in 0.000 Oct 16 01:05:49.447788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:05:49.448322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'02def970-29eb-4148-a20d-445ed75d4fe8', '199a6a07-ef81-454a-9a90-e16388fd8068', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d'} Oct 16 01:05:49.449133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 02def970-29eb-4148-a20d-445ed75d4fe8 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:05:49.449970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:05:49.523036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8baf551-6c44-4efb-9f03-5b91d372af01]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:05:49.523548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'02def970-29eb-4148-a20d-445ed75d4fe8', '199a6a07-ef81-454a-9a90-e16388fd8068', 'c9bf46df-7ac4-440c-8c35-1671b8a9814d'} removed Oct 16 01:05:49.648056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:05:49.649079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:05:49.650328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 11 from net-id = b461444f-0415-4655-b84a-88bf01b40b1a, seg-id = 374 Oct 16 01:05:49.656421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8ca7,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:49.661088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79416fd2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4470}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:49.663326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:491 - treat_devices_removed completed in 0.214 Oct 16 01:05:49.664237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:491 - ports processed. Elapsed:0.267 Oct 16 01:05:49.665122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.268 Oct 16 01:05:49.729640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea789369-91a0-42a2-bc80-3647ff87625d None None] Resource Port deleted: c9bf46df-7ac4-440c-8c35-1671b8a9814d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:49.739008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ea789369-91a0-42a2-bc80-3647ff87625d None None] Skipped duplicate delete event for c9bf46df-7ac4-440c-8c35-1671b8a9814d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 01:05:49.866295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c325d99-2a24-489e-9597-1b6a7b0fb5f5 admin admin] Resource Network deleted: b461444f-0415-4655-b84a-88bf01b40b1a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:49.866806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c325d99-2a24-489e-9597-1b6a7b0fb5f5 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (b461444f-0415-4655-b84a-88bf01b40b1a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.273263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Resource SecurityGroup deleted: 891f04f3-e71b-49ac-a5a5-21aec2e61c00 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.273627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (891f04f3-e71b-49ac-a5a5-21aec2e61c00), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.274101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('891f04f3-e71b-49ac-a5a5-21aec2e61c00',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:50.288790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('891f04f3-e71b-49ac-a5a5-21aec2e61c00',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:50.289519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Resource SecurityGroupRule deleted: 6a04c12a-f753-458c-896e-b7bf0c196494 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.289894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6a04c12a-f753-458c-896e-b7bf0c196494), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.290286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:05:50.290781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Resource SecurityGroupRule deleted: 850f0e26-b5f2-4486-8992-c68fcbc8abb6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.291105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (850f0e26-b5f2-4486-8992-c68fcbc8abb6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.291436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:05:50.291805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Resource SecurityGroupRule deleted: c6f52174-8c16-40eb-a264-1cb3fe2568c9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.292149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c6f52174-8c16-40eb-a264-1cb3fe2568c9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.292475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:05:50.293038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Resource SecurityGroupRule deleted: f1c9f430-62d5-4fc3-8a6c-9a3fe3aa7cea {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.293387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f1c9f430-62d5-4fc3-8a6c-9a3fe3aa7cea), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.293739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a21f0027-1e66-494d-9b23-7d2e3ac0d4d7 admin admin] Security group rule updated ['891f04f3-e71b-49ac-a5a5-21aec2e61c00'] Oct 16 01:05:50.839950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Resource SecurityGroup deleted: 2430aff5-6ca2-4d6a-8b4c-7570f30f43a1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.840617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (2430aff5-6ca2-4d6a-8b4c-7570f30f43a1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.840790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2430aff5-6ca2-4d6a-8b4c-7570f30f43a1',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:50.854832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2430aff5-6ca2-4d6a-8b4c-7570f30f43a1',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:50.855522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Resource SecurityGroupRule deleted: 1cfe6a7f-835b-42c9-9a99-46c1162dde5e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.855965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1cfe6a7f-835b-42c9-9a99-46c1162dde5e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.856427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:05:50.857052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Resource SecurityGroupRule deleted: 444cc49b-b24d-4ea7-9d26-08244d389e95 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.857552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (444cc49b-b24d-4ea7-9d26-08244d389e95), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.858032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:05:50.858565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Resource SecurityGroupRule deleted: 59aec7e5-7c78-4ca0-aa7f-a77ddb30cef6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.859113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (59aec7e5-7c78-4ca0-aa7f-a77ddb30cef6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.860280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:05:50.860280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Resource SecurityGroupRule deleted: de9d0398-5bd9-4c93-990b-2826da45d017 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:50.860699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (de9d0398-5bd9-4c93-990b-2826da45d017), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:50.861177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-45f0e0f2-c140-4045-b883-a26a6aa5bcc4 admin admin] Security group rule updated ['2430aff5-6ca2-4d6a-8b4c-7570f30f43a1'] Oct 16 01:05:51.398928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:492 started Oct 16 01:05:51.402068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fd4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=44000000,duration_sec=1018,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:51.402938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:51.403490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:492 - starting polling. Elapsed:0.005 Oct 16 01:05:51.406083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:51.407657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port c9bf46df-7ac4-440c-8c35-1671b8a9814d not present in bridge br-int Oct 16 01:05:51.408037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:05:51.408345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['c9bf46df-7ac4-440c-8c35-1671b8a9814d'] Oct 16 01:05:51.408682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port c9bf46df-7ac4-440c-8c35-1671b8a9814d is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:05:51.411254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:492 - port information retrieved. Elapsed:0.013 Oct 16 01:05:51.411629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:05:53.399455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:493 started Oct 16 01:05:53.401999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fd6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=45000000,duration_sec=1020,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:53.402698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:53.405454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 01:05:53.610269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:53Z,description='Default security group',id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,is_default=True,name='default',project_id='a170024b1fc84ea38cc4f49b65a114ff',revision_number=1,rules=[SecurityGroupRule(4ed0c16d-464a-4c91-b023-e9421dbb5cbf),SecurityGroupRule(52485511-c50d-4f90-befc-42814baedc33),SecurityGroupRule(68b19d92-a703-47c3-b38d-f6b55643a5f8),SecurityGroupRule(fab902b3-ea1e-413c-b3a5-8bb9099a1d82)],shared=False,stateful=True,updated_at=2022-10-16T01:05:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:53.610871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (e09afd2b-9085-4098-a0cf-b6cc4adf6d56), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.611527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:53Z,description=,direction='ingress',ethertype='IPv4',id=4ed0c16d-464a-4c91-b023-e9421dbb5cbf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a170024b1fc84ea38cc4f49b65a114ff',protocol=,remote_address_group_id=,remote_group_id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,remote_ip_prefix=,revision_number=0,security_group_id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,updated_at=2022-10-16T01:05:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:53.611896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4ed0c16d-464a-4c91-b023-e9421dbb5cbf), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.612238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.612915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:53Z,description=,direction='egress',ethertype='IPv4',id=52485511-c50d-4f90-befc-42814baedc33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a170024b1fc84ea38cc4f49b65a114ff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,updated_at=2022-10-16T01:05:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:53.613326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (52485511-c50d-4f90-befc-42814baedc33), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.613686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.614339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:53Z,description=,direction='egress',ethertype='IPv6',id=68b19d92-a703-47c3-b38d-f6b55643a5f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a170024b1fc84ea38cc4f49b65a114ff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,updated_at=2022-10-16T01:05:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:53.614692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (68b19d92-a703-47c3-b38d-f6b55643a5f8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.615763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.616521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:53Z,description=,direction='ingress',ethertype='IPv6',id=fab902b3-ea1e-413c-b3a5-8bb9099a1d82,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a170024b1fc84ea38cc4f49b65a114ff',protocol=,remote_address_group_id=,remote_group_id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,remote_ip_prefix=,revision_number=0,security_group_id=e09afd2b-9085-4098-a0cf-b6cc4adf6d56,updated_at=2022-10-16T01:05:53Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:53.616878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fab902b3-ea1e-413c-b3a5-8bb9099a1d82), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.617211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-024e6087-6c97-4f3b-ae29-24dce39777bb admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.775526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Resource SecurityGroup deleted: e09afd2b-9085-4098-a0cf-b6cc4adf6d56 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:53.775884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (e09afd2b-9085-4098-a0cf-b6cc4adf6d56), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.776438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e09afd2b-9085-4098-a0cf-b6cc4adf6d56',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:53.792551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e09afd2b-9085-4098-a0cf-b6cc4adf6d56',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:53.793206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Resource SecurityGroupRule deleted: 4ed0c16d-464a-4c91-b023-e9421dbb5cbf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:53.793616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4ed0c16d-464a-4c91-b023-e9421dbb5cbf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.794033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.794507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Resource SecurityGroupRule deleted: 52485511-c50d-4f90-befc-42814baedc33 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:53.795020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (52485511-c50d-4f90-befc-42814baedc33), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.795415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.795855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Resource SecurityGroupRule deleted: 68b19d92-a703-47c3-b38d-f6b55643a5f8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:53.796481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (68b19d92-a703-47c3-b38d-f6b55643a5f8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.796839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:53.797277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Resource SecurityGroupRule deleted: fab902b3-ea1e-413c-b3a5-8bb9099a1d82 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:53.797696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fab902b3-ea1e-413c-b3a5-8bb9099a1d82), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:53.798086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fc05004b-71ac-4418-9cd9-61d89c920cf1 admin admin] Security group rule updated ['e09afd2b-9085-4098-a0cf-b6cc4adf6d56'] Oct 16 01:05:54.218285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:54Z,description='Default security group',id=d085b933-490a-4e5f-adf5-5b2dd711b981,is_default=True,name='default',project_id='ea199a99cffe493ca2e2ec31d20ca500',revision_number=1,rules=[SecurityGroupRule(4cb24858-3071-41de-bca6-4c0c4eaf84b0),SecurityGroupRule(b7d854ff-cd0d-4efa-9cbc-19bb7b1d3e13),SecurityGroupRule(e4b276d0-283e-478d-839e-bcd256328f3b),SecurityGroupRule(e61e8eb4-f488-44b1-a92a-9771fdbdbf43)],shared=False,stateful=True,updated_at=2022-10-16T01:05:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:54.218579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (d085b933-490a-4e5f-adf5-5b2dd711b981), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.219246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:54Z,description=,direction='egress',ethertype='IPv6',id=4cb24858-3071-41de-bca6-4c0c4eaf84b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea199a99cffe493ca2e2ec31d20ca500',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d085b933-490a-4e5f-adf5-5b2dd711b981,updated_at=2022-10-16T01:05:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:54.219639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4cb24858-3071-41de-bca6-4c0c4eaf84b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.219977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.220719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:54Z,description=,direction='ingress',ethertype='IPv4',id=b7d854ff-cd0d-4efa-9cbc-19bb7b1d3e13,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea199a99cffe493ca2e2ec31d20ca500',protocol=,remote_address_group_id=,remote_group_id=d085b933-490a-4e5f-adf5-5b2dd711b981,remote_ip_prefix=,revision_number=0,security_group_id=d085b933-490a-4e5f-adf5-5b2dd711b981,updated_at=2022-10-16T01:05:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:54.221072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b7d854ff-cd0d-4efa-9cbc-19bb7b1d3e13), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.221400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.222086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:54Z,description=,direction='ingress',ethertype='IPv6',id=e4b276d0-283e-478d-839e-bcd256328f3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea199a99cffe493ca2e2ec31d20ca500',protocol=,remote_address_group_id=,remote_group_id=d085b933-490a-4e5f-adf5-5b2dd711b981,remote_ip_prefix=,revision_number=0,security_group_id=d085b933-490a-4e5f-adf5-5b2dd711b981,updated_at=2022-10-16T01:05:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:54.222469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e4b276d0-283e-478d-839e-bcd256328f3b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.222794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.223468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:54Z,description=,direction='egress',ethertype='IPv4',id=e61e8eb4-f488-44b1-a92a-9771fdbdbf43,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ea199a99cffe493ca2e2ec31d20ca500',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d085b933-490a-4e5f-adf5-5b2dd711b981,updated_at=2022-10-16T01:05:54Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:54.223842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e61e8eb4-f488-44b1-a92a-9771fdbdbf43), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.224206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e6885cc6-3599-4f42-a22c-323a5a5a129f admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.363816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Resource SecurityGroup deleted: d085b933-490a-4e5f-adf5-5b2dd711b981 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:54.364445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (d085b933-490a-4e5f-adf5-5b2dd711b981), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.365221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d085b933-490a-4e5f-adf5-5b2dd711b981',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:54.386699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d085b933-490a-4e5f-adf5-5b2dd711b981',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:54.387384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Resource SecurityGroupRule deleted: 4cb24858-3071-41de-bca6-4c0c4eaf84b0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:54.387792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4cb24858-3071-41de-bca6-4c0c4eaf84b0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.388133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.388533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Resource SecurityGroupRule deleted: b7d854ff-cd0d-4efa-9cbc-19bb7b1d3e13 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:54.388888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b7d854ff-cd0d-4efa-9cbc-19bb7b1d3e13), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.389311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.395103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Resource SecurityGroupRule deleted: e4b276d0-283e-478d-839e-bcd256328f3b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:54.395712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e4b276d0-283e-478d-839e-bcd256328f3b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.396952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:54.397940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Resource SecurityGroupRule deleted: e61e8eb4-f488-44b1-a92a-9771fdbdbf43 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:54.398379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e61e8eb4-f488-44b1-a92a-9771fdbdbf43), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:54.398908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-5732d2d6-bef9-491e-9025-8cbe7d8ca4be admin admin] Security group rule updated ['d085b933-490a-4e5f-adf5-5b2dd711b981'] Oct 16 01:05:55.402958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:494 started Oct 16 01:05:55.403558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fd8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=46000000,duration_sec=1022,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:55.404188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:55.404718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:05:56.806121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 8650d000-9eba-4333-85df-35ab0580d9c1 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:05:56.806993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (8650d000-9eba-4333-85df-35ab0580d9c1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:56.893700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:56Z,description='Default security group',id=542b9cc6-efbb-434b-8037-8afa41f57e78,is_default=True,name='default',project_id='5ea962541a1e43c9a6df32518a591d45',revision_number=1,rules=[SecurityGroupRule(2d153fe3-8b1c-437d-bd8c-8720e080f20c),SecurityGroupRule(4660b8ad-6ebd-445c-8436-c94f7d78f529),SecurityGroupRule(803e8873-c64c-4e86-9e92-e5903f2366d0),SecurityGroupRule(86df53be-3158-44d7-bf84-a5e215894dae)],shared=False,stateful=True,updated_at=2022-10-16T01:05:56Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:56.894084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (542b9cc6-efbb-434b-8037-8afa41f57e78), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:56.894747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:56Z,description=,direction='egress',ethertype='IPv4',id=2d153fe3-8b1c-437d-bd8c-8720e080f20c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ea962541a1e43c9a6df32518a591d45',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=542b9cc6-efbb-434b-8037-8afa41f57e78,updated_at=2022-10-16T01:05:56Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:56.895135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2d153fe3-8b1c-437d-bd8c-8720e080f20c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:56.895472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:56.896264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:56Z,description=,direction='ingress',ethertype='IPv6',id=4660b8ad-6ebd-445c-8436-c94f7d78f529,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ea962541a1e43c9a6df32518a591d45',protocol=,remote_address_group_id=,remote_group_id=542b9cc6-efbb-434b-8037-8afa41f57e78,remote_ip_prefix=,revision_number=0,security_group_id=542b9cc6-efbb-434b-8037-8afa41f57e78,updated_at=2022-10-16T01:05:56Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:56.896632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4660b8ad-6ebd-445c-8436-c94f7d78f529), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:56.896979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:56.897713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:56Z,description=,direction='egress',ethertype='IPv6',id=803e8873-c64c-4e86-9e92-e5903f2366d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ea962541a1e43c9a6df32518a591d45',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=542b9cc6-efbb-434b-8037-8afa41f57e78,updated_at=2022-10-16T01:05:56Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:56.898068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (803e8873-c64c-4e86-9e92-e5903f2366d0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:56.898393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:56.899174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:56Z,description=,direction='ingress',ethertype='IPv4',id=86df53be-3158-44d7-bf84-a5e215894dae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ea962541a1e43c9a6df32518a591d45',protocol=,remote_address_group_id=,remote_group_id=542b9cc6-efbb-434b-8037-8afa41f57e78,remote_ip_prefix=,revision_number=0,security_group_id=542b9cc6-efbb-434b-8037-8afa41f57e78,updated_at=2022-10-16T01:05:56Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:56.899533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (86df53be-3158-44d7-bf84-a5e215894dae), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:56.899854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ddba0476-6a81-46bc-a3b9-88efa0e7514f admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:57.055109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Resource SecurityGroup deleted: 542b9cc6-efbb-434b-8037-8afa41f57e78 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.055938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (542b9cc6-efbb-434b-8037-8afa41f57e78), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.056399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('542b9cc6-efbb-434b-8037-8afa41f57e78',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:57.096553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('542b9cc6-efbb-434b-8037-8afa41f57e78',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:57.097023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Resource SecurityGroupRule deleted: 2d153fe3-8b1c-437d-bd8c-8720e080f20c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.097743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2d153fe3-8b1c-437d-bd8c-8720e080f20c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.097743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:57.098109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Resource SecurityGroupRule deleted: 4660b8ad-6ebd-445c-8436-c94f7d78f529 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.098457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4660b8ad-6ebd-445c-8436-c94f7d78f529), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.098781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:57.103531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Resource SecurityGroupRule deleted: 803e8873-c64c-4e86-9e92-e5903f2366d0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.103913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (803e8873-c64c-4e86-9e92-e5903f2366d0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.104284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:57.104663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Resource SecurityGroupRule deleted: 86df53be-3158-44d7-bf84-a5e215894dae {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.105009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (86df53be-3158-44d7-bf84-a5e215894dae), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.105416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-f9f55686-08cc-4af6-8ddb-b56b80267182 admin admin] Security group rule updated ['542b9cc6-efbb-434b-8037-8afa41f57e78'] Oct 16 01:05:57.401393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:495 started Oct 16 01:05:57.405016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fda,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=47000000,duration_sec=1024,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:57.405690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:57.406029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:495 - starting polling. Elapsed:0.005 Oct 16 01:05:57.408084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.410671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:495 - port information retrieved. Elapsed:0.009 Oct 16 01:05:57.411042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 01:05:57.522085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:05:57Z,description='Default security group',id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,is_default=True,name='default',project_id='149fb4bc8e1a47ffa2c194edd8318b48',revision_number=1,rules=[SecurityGroupRule(19a631a4-177d-440e-b5d4-0578bbefdb94),SecurityGroupRule(86407d98-d6d3-4377-8313-bae4d31cab03),SecurityGroupRule(971ec5a2-cf48-4ce9-88d8-6140680cc4d8),SecurityGroupRule(b2187e9d-47a9-499e-90af-b2ac1a625bb3)],shared=False,stateful=True,updated_at=2022-10-16T01:05:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:57.522545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (f4c7df05-0a8c-46bf-b52a-01e2239253a2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.523501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:57Z,description=,direction='ingress',ethertype='IPv6',id=19a631a4-177d-440e-b5d4-0578bbefdb94,normalized_cidr=None,port_range_max=,port_range_min=,project_id='149fb4bc8e1a47ffa2c194edd8318b48',protocol=,remote_address_group_id=,remote_group_id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,remote_ip_prefix=,revision_number=0,security_group_id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,updated_at=2022-10-16T01:05:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:57.524341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (19a631a4-177d-440e-b5d4-0578bbefdb94), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.524687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.525397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:57Z,description=,direction='ingress',ethertype='IPv4',id=86407d98-d6d3-4377-8313-bae4d31cab03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='149fb4bc8e1a47ffa2c194edd8318b48',protocol=,remote_address_group_id=,remote_group_id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,remote_ip_prefix=,revision_number=0,security_group_id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,updated_at=2022-10-16T01:05:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:57.525757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (86407d98-d6d3-4377-8313-bae4d31cab03), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.526091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.526750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:57Z,description=,direction='egress',ethertype='IPv6',id=971ec5a2-cf48-4ce9-88d8-6140680cc4d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='149fb4bc8e1a47ffa2c194edd8318b48',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,updated_at=2022-10-16T01:05:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:57.527137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (971ec5a2-cf48-4ce9-88d8-6140680cc4d8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.527470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.528123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:05:57Z,description=,direction='egress',ethertype='IPv4',id=b2187e9d-47a9-499e-90af-b2ac1a625bb3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='149fb4bc8e1a47ffa2c194edd8318b48',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f4c7df05-0a8c-46bf-b52a-01e2239253a2,updated_at=2022-10-16T01:05:57Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:05:57.528479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b2187e9d-47a9-499e-90af-b2ac1a625bb3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.528807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8dfb0b3e-3e1f-448a-9db9-7a00f22493a1 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.665747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Resource SecurityGroup deleted: f4c7df05-0a8c-46bf-b52a-01e2239253a2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.666212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (f4c7df05-0a8c-46bf-b52a-01e2239253a2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.666676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f4c7df05-0a8c-46bf-b52a-01e2239253a2',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:05:57.685887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f4c7df05-0a8c-46bf-b52a-01e2239253a2',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:05:57.686359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Resource SecurityGroupRule deleted: 19a631a4-177d-440e-b5d4-0578bbefdb94 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.686738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (19a631a4-177d-440e-b5d4-0578bbefdb94), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.687114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.687522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Resource SecurityGroupRule deleted: 86407d98-d6d3-4377-8313-bae4d31cab03 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.688431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (86407d98-d6d3-4377-8313-bae4d31cab03), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.688431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.688653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Resource SecurityGroupRule deleted: 971ec5a2-cf48-4ce9-88d8-6140680cc4d8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.688920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (971ec5a2-cf48-4ce9-88d8-6140680cc4d8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.689246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:57.690280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Resource SecurityGroupRule deleted: b2187e9d-47a9-499e-90af-b2ac1a625bb3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:05:57.690280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b2187e9d-47a9-499e-90af-b2ac1a625bb3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:57.690280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbb1f583-832e-47d0-83f1-d19d9d3579b3 admin admin] Security group rule updated ['f4c7df05-0a8c-46bf-b52a-01e2239253a2'] Oct 16 01:05:58.842457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 8650d000-9eba-4333-85df-35ab0580d9c1 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:05:58.844215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (8650d000-9eba-4333-85df-35ab0580d9c1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:59.402284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:496 started Oct 16 01:05:59.404936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fdc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=48000000,duration_sec=1026,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:05:59.405528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:05:59.406650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:496 - starting polling. Elapsed:0.005 Oct 16 01:05:59.408798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:05:59.412302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:496 - port information retrieved. Elapsed:0.010 Oct 16 01:05:59.412782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 01:06:01.403762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:497 started Oct 16 01:06:01.406211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fde,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=49000000,duration_sec=1028,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:01.406784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:01.407170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:02.940063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84dc6a8a-f6a7-40f6-bb3d-ea6036526b82 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:06:02Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4421e167-6168-4c78-9293-a1d72e2e60b0,mac_address=fa:16:3e:4d:fb:41,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4421e167-6168-4c78-9293-a1d72e2e60b0),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:06:02Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:02.940702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84dc6a8a-f6a7-40f6-bb3d-ea6036526b82 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4421e167-6168-4c78-9293-a1d72e2e60b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:03.404841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:498 started Oct 16 01:06:03.407787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fe0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=51000000,duration_sec=1030,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:03.408376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:03.408720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:498 - starting polling. Elapsed:0.004 Oct 16 01:06:03.410750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:03.413426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:498 - port information retrieved. Elapsed:0.009 Oct 16 01:06:03.413774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:03.711990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-84dc6a8a-f6a7-40f6-bb3d-ea6036526b82 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port 4421e167-6168-4c78-9293-a1d72e2e60b0 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'daa41628-51ee-46e5-a35c-614990c2b6fb'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:03.712886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-84dc6a8a-f6a7-40f6-bb3d-ea6036526b82 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (4421e167-6168-4c78-9293-a1d72e2e60b0), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:05.406377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:499 started Oct 16 01:06:05.409321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fe2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=52000000,duration_sec=1032,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:05.409652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:05.409993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:499 - starting polling. Elapsed:0.004 Oct 16 01:06:05.412554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:05.417194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:499 - port information retrieved. Elapsed:0.011 Oct 16 01:06:05.417749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 01:06:07.408271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:500 started Oct 16 01:06:07.410637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fe4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=54000000,duration_sec=1034,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:07.411450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:07.411810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:09.409348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:501 started Oct 16 01:06:09.412619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fe6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=55000000,duration_sec=1036,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:09.413186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:09.413540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:09.618011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:06:09Z,description='Default security group',id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,is_default=True,name='default',project_id='df4780ffda6e4ce39233f4d208f52c3e',revision_number=1,rules=[SecurityGroupRule(23f88450-0e56-428b-993d-0a28e0085c95),SecurityGroupRule(7c284045-2aa7-4ef5-8038-4afa418865ee),SecurityGroupRule(c62e846f-0a84-45f2-a77b-4aee661bc8dd),SecurityGroupRule(d4ba308e-f9bc-4e72-98ee-d64f8cfb3350)],shared=False,stateful=True,updated_at=2022-10-16T01:06:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:09.618337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (597d51f3-c4f5-4d5a-b0ae-706bea86c2d5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.619002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:09Z,description=,direction='ingress',ethertype='IPv4',id=23f88450-0e56-428b-993d-0a28e0085c95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df4780ffda6e4ce39233f4d208f52c3e',protocol=,remote_address_group_id=,remote_group_id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,remote_ip_prefix=,revision_number=0,security_group_id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,updated_at=2022-10-16T01:06:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:09.619367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (23f88450-0e56-428b-993d-0a28e0085c95), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.619678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.620350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:09Z,description=,direction='ingress',ethertype='IPv6',id=7c284045-2aa7-4ef5-8038-4afa418865ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df4780ffda6e4ce39233f4d208f52c3e',protocol=,remote_address_group_id=,remote_group_id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,remote_ip_prefix=,revision_number=0,security_group_id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,updated_at=2022-10-16T01:06:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:09.620727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (7c284045-2aa7-4ef5-8038-4afa418865ee), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.621051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.621697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:09Z,description=,direction='egress',ethertype='IPv6',id=c62e846f-0a84-45f2-a77b-4aee661bc8dd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df4780ffda6e4ce39233f4d208f52c3e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,updated_at=2022-10-16T01:06:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:09.622044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c62e846f-0a84-45f2-a77b-4aee661bc8dd), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.622364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.623039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:09Z,description=,direction='egress',ethertype='IPv4',id=d4ba308e-f9bc-4e72-98ee-d64f8cfb3350,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df4780ffda6e4ce39233f4d208f52c3e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=597d51f3-c4f5-4d5a-b0ae-706bea86c2d5,updated_at=2022-10-16T01:06:09Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:09.623386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d4ba308e-f9bc-4e72-98ee-d64f8cfb3350), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.623708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1bfd14c4-63ec-43cd-b74e-6e92e2fca3c1 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.759601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Resource SecurityGroup deleted: 597d51f3-c4f5-4d5a-b0ae-706bea86c2d5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:09.760326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (597d51f3-c4f5-4d5a-b0ae-706bea86c2d5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.761144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('597d51f3-c4f5-4d5a-b0ae-706bea86c2d5',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:06:09.778772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('597d51f3-c4f5-4d5a-b0ae-706bea86c2d5',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:06:09.780255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Resource SecurityGroupRule deleted: 23f88450-0e56-428b-993d-0a28e0085c95 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:09.780836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (23f88450-0e56-428b-993d-0a28e0085c95), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.781663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.782274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Resource SecurityGroupRule deleted: 7c284045-2aa7-4ef5-8038-4afa418865ee {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:09.782894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (7c284045-2aa7-4ef5-8038-4afa418865ee), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.784211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Resource SecurityGroupRule deleted: c62e846f-0a84-45f2-a77b-4aee661bc8dd {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:09.784854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c62e846f-0a84-45f2-a77b-4aee661bc8dd), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.785592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:09.787136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Resource SecurityGroupRule deleted: d4ba308e-f9bc-4e72-98ee-d64f8cfb3350 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:09.787621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d4ba308e-f9bc-4e72-98ee-d64f8cfb3350), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:09.788813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b9e8dfc6-f47e-4b2e-b992-a139897d7a58 admin admin] Security group rule updated ['597d51f3-c4f5-4d5a-b0ae-706bea86c2d5'] Oct 16 01:06:10.671091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:06:10Z,description='Default security group',id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,is_default=True,name='default',project_id='c322a47bb2364c8ea9250a7ecea537bf',revision_number=1,rules=[SecurityGroupRule(2d6ab514-2d23-40bb-9708-fe361aac1838),SecurityGroupRule(3c7a3de8-318b-4994-83a1-d6e09e4840df),SecurityGroupRule(c4d84dcb-2be2-4ea3-bfb2-9d8f4252e1ef),SecurityGroupRule(e9b1038b-d01a-4e69-96f8-f7ee067e9bc4)],shared=False,stateful=True,updated_at=2022-10-16T01:06:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:10.671718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (db2762ca-4e2b-467c-b3dc-a74eeffcc3d3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:10.672089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:10Z,description=,direction='ingress',ethertype='IPv6',id=2d6ab514-2d23-40bb-9708-fe361aac1838,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c322a47bb2364c8ea9250a7ecea537bf',protocol=,remote_address_group_id=,remote_group_id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,remote_ip_prefix=,revision_number=0,security_group_id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,updated_at=2022-10-16T01:06:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:10.672455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2d6ab514-2d23-40bb-9708-fe361aac1838), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:10.672817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:06:10.673489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:10Z,description=,direction='egress',ethertype='IPv4',id=3c7a3de8-318b-4994-83a1-d6e09e4840df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c322a47bb2364c8ea9250a7ecea537bf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,updated_at=2022-10-16T01:06:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:10.673844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3c7a3de8-318b-4994-83a1-d6e09e4840df), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:10.674177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:06:10.674828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:10Z,description=,direction='egress',ethertype='IPv6',id=c4d84dcb-2be2-4ea3-bfb2-9d8f4252e1ef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c322a47bb2364c8ea9250a7ecea537bf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,updated_at=2022-10-16T01:06:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:10.675205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c4d84dcb-2be2-4ea3-bfb2-9d8f4252e1ef), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:10.675549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:06:10.676216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:10Z,description=,direction='ingress',ethertype='IPv4',id=e9b1038b-d01a-4e69-96f8-f7ee067e9bc4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c322a47bb2364c8ea9250a7ecea537bf',protocol=,remote_address_group_id=,remote_group_id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,remote_ip_prefix=,revision_number=0,security_group_id=db2762ca-4e2b-467c-b3dc-a74eeffcc3d3,updated_at=2022-10-16T01:06:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:10.677462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (e9b1038b-d01a-4e69-96f8-f7ee067e9bc4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:10.677830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:06:10.805529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-10-16T01:06:10Z,description='',dns_domain=None,id=00f07626-fa08-4fe1-b8db-0b77245228f3,mtu=1500,name='tempest-VolumesSnapshotTestJSON-1781712430-network',project_id='c322a47bb2364c8ea9250a7ecea537bf',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(00f07626-fa08-4fe1-b8db-0b77245228f3),segments=[NetworkSegment(ce390ca2-87a7-430c-b04c-11a2884592e0)],shared=False,status='ACTIVE',updated_at=2022-10-16T01:06:10Z,vlan_transparent=) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:10.806103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (00f07626-fa08-4fe1-b8db-0b77245228f3), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager [None req-351d5e40-981a-4a80-bd66-6aa43ce6809e admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 00f07626-fa08-4fe1-b8db-0b77245228f3 with segmentation id not found. Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Oct 16 01:06:10.878556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Oct 16 01:06:10.879899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Oct 16 01:06:10.879899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Oct 16 01:06:10.879899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Oct 16 01:06:10.879899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 00f07626-fa08-4fe1-b8db-0b77245228f3 with segmentation id not found. Oct 16 01:06:10.879899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: ERROR neutron_lib.callbacks.manager Oct 16 01:06:11.066767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0004fc1a-c5f6-415a-a1c6-00b1232d47da admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(567b8b23-6ab3-458c-8451-d0b1655a1b96)],cidr=172.20.0.0/28,created_at=2022-10-16T01:06:10Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=2719eb6f-42f8-40e2-94fe-1aae0fcee16d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-1781712430-subnet',network_id=00f07626-fa08-4fe1-b8db-0b77245228f3,project_id='c322a47bb2364c8ea9250a7ecea537bf',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-10-16T01:06:10Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:11.067236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0004fc1a-c5f6-415a-a1c6-00b1232d47da admin admin] Publish callbacks [] for Subnet (2719eb6f-42f8-40e2-94fe-1aae0fcee16d), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:11.409982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:502 started Oct 16 01:06:11.413001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fe8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=55000000,duration_sec=1038,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:11.413839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:11.414121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:13.411411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:503 started Oct 16 01:06:13.413957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=57000000,duration_sec=1040,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:13.414525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:13.414918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:15.309804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d5ab3580-31ab-432d-b12a-16522781e3b3 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:06:14Z,data_plane_status=None,description='',device_id='d1be419e-f50d-4116-aa44-9055c7014141',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=030acd90-8e8f-444f-b83a-e384f9ea5bce,mac_address=fa:16:3e:78:bc:5f,name='',network_id=00f07626-fa08-4fe1-b8db-0b77245228f3,numa_affinity_policy=,project_id='c322a47bb2364c8ea9250a7ecea537bf',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(030acd90-8e8f-444f-b83a-e384f9ea5bce),security_group_ids=set([db2762ca-4e2b-467c-b3dc-a74eeffcc3d3]),status='DOWN',updated_at=2022-10-16T01:06:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:15.310460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d5ab3580-31ab-432d-b12a-16522781e3b3 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (030acd90-8e8f-444f-b83a-e384f9ea5bce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:15.310675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d5ab3580-31ab-432d-b12a-16522781e3b3 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Security group member updated {'db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'} Oct 16 01:06:15.412905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:504 started Oct 16 01:06:15.415456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=58000000,duration_sec=1042,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:15.416208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:15.416622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:504 - starting polling. Elapsed:0.004 Oct 16 01:06:15.418705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:15.421708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:504 - port information retrieved. Elapsed:0.009 Oct 16 01:06:15.422091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:15.801176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e1a9b2c-25c7-48be-9cfb-fe2e1d4bf4b2 service neutron] Resource Port 030acd90-8e8f-444f-b83a-e384f9ea5bce updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=030acd90-8e8f-444f-b83a-e384f9ea5bce,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=030acd90-8e8f-444f-b83a-e384f9ea5bce,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:15.801567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e1a9b2c-25c7-48be-9cfb-fe2e1d4bf4b2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (030acd90-8e8f-444f-b83a-e384f9ea5bce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:16.094239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3e1a9b2c-25c7-48be-9cfb-fe2e1d4bf4b2 service neutron] Resource Port 030acd90-8e8f-444f-b83a-e384f9ea5bce updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=030acd90-8e8f-444f-b83a-e384f9ea5bce,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=030acd90-8e8f-444f-b83a-e384f9ea5bce,segment=NetworkSegment(ce390ca2-87a7-430c-b04c-11a2884592e0),segment_id=ce390ca2-87a7-430c-b04c-11a2884592e0)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=030acd90-8e8f-444f-b83a-e384f9ea5bce,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:16.094629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3e1a9b2c-25c7-48be-9cfb-fe2e1d4bf4b2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (030acd90-8e8f-444f-b83a-e384f9ea5bce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:17.413649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:505 started Oct 16 01:06:17.416229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416fee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=59000000,duration_sec=1044,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:17.416869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:17.417222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:505 - starting polling. Elapsed:0.004 Oct 16 01:06:17.419280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:17.421815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:505 - port information retrieved. Elapsed:0.008 Oct 16 01:06:17.422252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:18.919360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 030acd90-8e8f-444f-b83a-e384f9ea5bce updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:18.920133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (030acd90-8e8f-444f-b83a-e384f9ea5bce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:19.414591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:506 started Oct 16 01:06:19.417137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ff0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=60000000,duration_sec=1046,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:19.417710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:19.418053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:506 - starting polling. Elapsed:0.004 Oct 16 01:06:19.420117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:19.422674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:506 - port information retrieved. Elapsed:0.008 Oct 16 01:06:19.423048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:20.914224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 030acd90-8e8f-444f-b83a-e384f9ea5bce updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:20.914954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (030acd90-8e8f-444f-b83a-e384f9ea5bce), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:21.416187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:507 started Oct 16 01:06:21.420284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ff2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=62000000,duration_sec=1048,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:21.420957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:21.421656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:507 - starting polling. Elapsed:0.005 Oct 16 01:06:21.423800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:21.428303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:507 - port information retrieved. Elapsed:0.011 Oct 16 01:06:21.429042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:06:23.417055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:508 started Oct 16 01:06:23.419653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ff4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=63000000,duration_sec=1050,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:23.420252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:23.420603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:25.181837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4d82b310-f9f2-4cf1-ab70-6c2c3d9b03a4 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource Port deleted: 01028fe7-7644-4a03-bb34-6762d2043774 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:25.183209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4d82b310-f9f2-4cf1-ab70-6c2c3d9b03a4 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (01028fe7-7644-4a03-bb34-6762d2043774), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:25.183968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4d82b310-f9f2-4cf1-ab70-6c2c3d9b03a4 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group member updated {'56de6e02-e079-44a1-8388-7aaeb8270eaf'} Oct 16 01:06:25.418568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:509 started Oct 16 01:06:25.421320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ff6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=64000000,duration_sec=1052,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:25.421916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:25.422263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:509 - starting polling. Elapsed:0.004 Oct 16 01:06:25.424767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:25.426484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 01028fe7-7644-4a03-bb34-6762d2043774 not present in bridge br-int Oct 16 01:06:25.426484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:06:25.426773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['01028fe7-7644-4a03-bb34-6762d2043774'] Oct 16 01:06:25.427683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 01028fe7-7644-4a03-bb34-6762d2043774 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:06:25.435118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:509 - port information retrieved. Elapsed:0.014 Oct 16 01:06:25.435118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:06:26.467403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroup deleted: 56de6e02-e079-44a1-8388-7aaeb8270eaf {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:26.468031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (56de6e02-e079-44a1-8388-7aaeb8270eaf), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:26.468513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('56de6e02-e079-44a1-8388-7aaeb8270eaf',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:06:26.487077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('56de6e02-e079-44a1-8388-7aaeb8270eaf',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:06:26.487617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: 5a064834-6cfa-42f0-a6fe-ebefae60c38d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:26.487993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5a064834-6cfa-42f0-a6fe-ebefae60c38d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:26.488333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:06:26.490309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: d3050b82-b458-4cf2-83af-bb6fd66400c5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:26.490737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d3050b82-b458-4cf2-83af-bb6fd66400c5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:26.491145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:06:26.491527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: 72d38621-4a25-4604-99fa-3f1b5ee8e552 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:26.491875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (72d38621-4a25-4604-99fa-3f1b5ee8e552), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:26.492199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:06:26.493717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: 1b1b654a-a34b-481d-9788-98f22ee5a68a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:26.494281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1b1b654a-a34b-481d-9788-98f22ee5a68a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:26.494772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1acbe4a9-2270-4f5d-a65b-cc3331bbcdbe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['56de6e02-e079-44a1-8388-7aaeb8270eaf'] Oct 16 01:06:26.890790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c5894b98-e6a7-4fdc-8f36-1a38bde030cf tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource Port deleted: e7c812e1-34db-4018-99c1-10152ebd52ad {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:06:26.891302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c5894b98-e6a7-4fdc-8f36-1a38bde030cf tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (e7c812e1-34db-4018-99c1-10152ebd52ad), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.191430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:06:27Z,description='tempest-description--1038479945',id=3e390656-dd0d-43cf-8c2e-fdedef30e802,is_default=False,name='tempest-securitygroup--905271810',project_id='b8852bfe31aa4ba68190661d26c177cb',revision_number=1,rules=[SecurityGroupRule(12094663-389a-49a0-b3da-de7506c89df6),SecurityGroupRule(fa7acd47-6c6c-4d41-8097-02860e342ed2)],shared=False,stateful=True,updated_at=2022-10-16T01:06:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:27.195915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3e390656-dd0d-43cf-8c2e-fdedef30e802), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.196578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:27Z,description=,direction='egress',ethertype='IPv6',id=12094663-389a-49a0-b3da-de7506c89df6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3e390656-dd0d-43cf-8c2e-fdedef30e802,updated_at=2022-10-16T01:06:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:27.196949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (12094663-389a-49a0-b3da-de7506c89df6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.197318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:06:27.198031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:27Z,description=,direction='egress',ethertype='IPv4',id=fa7acd47-6c6c-4d41-8097-02860e342ed2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3e390656-dd0d-43cf-8c2e-fdedef30e802,updated_at=2022-10-16T01:06:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:27.198438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (fa7acd47-6c6c-4d41-8097-02860e342ed2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.198770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ba9bee6b-bfd7-4a8b-a87b-c0dad0ea7704 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:06:27.311594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-235f416d-fbb6-4afc-884b-54f1de0fe3e3 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:27Z,description='',direction='ingress',ethertype='IPv4',id=91d163a8-d119-4a29-9908-24e2e4bd045e,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3e390656-dd0d-43cf-8c2e-fdedef30e802,updated_at=2022-10-16T01:06:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:27.311991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-235f416d-fbb6-4afc-884b-54f1de0fe3e3 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (91d163a8-d119-4a29-9908-24e2e4bd045e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.312457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-235f416d-fbb6-4afc-884b-54f1de0fe3e3 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:06:27.419832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:510 started Oct 16 01:06:27.422989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ff8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=65000000,duration_sec=1054,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:27.424025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:27.424530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:510 - starting polling. Elapsed:0.005 Oct 16 01:06:27.427627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.430297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port e7c812e1-34db-4018-99c1-10152ebd52ad not present in bridge br-int Oct 16 01:06:27.430297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:06:27.430509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['e7c812e1-34db-4018-99c1-10152ebd52ad'] Oct 16 01:06:27.430798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port e7c812e1-34db-4018-99c1-10152ebd52ad is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:06:27.433360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:510 - port information retrieved. Elapsed:0.014 Oct 16 01:06:27.433721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:06:27.445852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a1ebc489-87b1-46ae-90e7-62272c0e98f1 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:06:27Z,description='',direction='ingress',ethertype='IPv4',id=00f034a5-7789-44a0-8cd9-d8371407989f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8852bfe31aa4ba68190661d26c177cb',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3e390656-dd0d-43cf-8c2e-fdedef30e802,updated_at=2022-10-16T01:06:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:27.446315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a1ebc489-87b1-46ae-90e7-62272c0e98f1 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (00f034a5-7789-44a0-8cd9-d8371407989f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:27.446736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a1ebc489-87b1-46ae-90e7-62272c0e98f1 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:06:27.878083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b1c5309-c444-4279-ad08-05b5fa8d4860 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:06:27Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e955ac14-5202-4518-b5b9-c5716fee8c28,mac_address=fa:16:3e:79:a6:12,name='',network_id=208c62ac-592a-4dec-a1cf-31599d23bbee,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e955ac14-5202-4518-b5b9-c5716fee8c28),security_group_ids=set([]),status='N/A',updated_at=2022-10-16T01:06:27Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:27.878899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b1c5309-c444-4279-ad08-05b5fa8d4860 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e955ac14-5202-4518-b5b9-c5716fee8c28), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:28.248605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1b1c5309-c444-4279-ad08-05b5fa8d4860 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource Port e955ac14-5202-4518-b5b9-c5716fee8c28 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '71c10ab4-24b3-4e02-9211-d561f3da126a'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:28.249020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1b1c5309-c444-4279-ad08-05b5fa8d4860 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (e955ac14-5202-4518-b5b9-c5716fee8c28), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:29.421183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:511 started Oct 16 01:06:29.423776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ffa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=67000000,duration_sec=1056,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:29.424419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:29.424741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:511 - starting polling. Elapsed:0.004 Oct 16 01:06:29.426766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:29.430962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:511 - port information retrieved. Elapsed:0.010 Oct 16 01:06:29.431867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 01:06:31.104038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6f01bae9-40e2-4f6e-9470-58f73b36e5fe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:06:30Z,data_plane_status=None,description='',device_id='78ed622b-285f-4f9b-a373-bdfc9b667fc6',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b75f86c7-a0ac-43e2-8da9-10f736efe195,mac_address=fa:16:3e:0a:45:33,name='',network_id=57335160-65ed-4241-a862-dbf37da52fd2,numa_affinity_policy=,project_id='b8852bfe31aa4ba68190661d26c177cb',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b75f86c7-a0ac-43e2-8da9-10f736efe195),security_group_ids=set([3e390656-dd0d-43cf-8c2e-fdedef30e802]),status='DOWN',updated_at=2022-10-16T01:06:30Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:06:31.105242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6f01bae9-40e2-4f6e-9470-58f73b36e5fe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b75f86c7-a0ac-43e2-8da9-10f736efe195), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:31.105792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6f01bae9-40e2-4f6e-9470-58f73b36e5fe tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group member updated {'3e390656-dd0d-43cf-8c2e-fdedef30e802'} Oct 16 01:06:31.422405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:512 started Oct 16 01:06:31.426090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ffc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=69000000,duration_sec=1058,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:31.427102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:31.427515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:512 - starting polling. Elapsed:0.005 Oct 16 01:06:31.430385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:31.432991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:512 - port information retrieved. Elapsed:0.011 Oct 16 01:06:31.433434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 01:06:31.607995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b54a8bdc-6516-417b-9f82-bb74cb0eab51 service neutron] Resource Port b75f86c7-a0ac-43e2-8da9-10f736efe195 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=b75f86c7-a0ac-43e2-8da9-10f736efe195,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b75f86c7-a0ac-43e2-8da9-10f736efe195,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:31.608581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b54a8bdc-6516-417b-9f82-bb74cb0eab51 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b75f86c7-a0ac-43e2-8da9-10f736efe195), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:31.929715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b54a8bdc-6516-417b-9f82-bb74cb0eab51 service neutron] Resource Port b75f86c7-a0ac-43e2-8da9-10f736efe195 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b75f86c7-a0ac-43e2-8da9-10f736efe195,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b75f86c7-a0ac-43e2-8da9-10f736efe195,segment=NetworkSegment(a2b144b3-1489-4a11-bdb8-6be66ef8e43c),segment_id=a2b144b3-1489-4a11-bdb8-6be66ef8e43c)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b75f86c7-a0ac-43e2-8da9-10f736efe195,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:31.930183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b54a8bdc-6516-417b-9f82-bb74cb0eab51 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b75f86c7-a0ac-43e2-8da9-10f736efe195), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:33.423919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:513 started Oct 16 01:06:33.426435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79416ffe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=69000000,duration_sec=1060,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:33.427050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:33.427396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:513 - starting polling. Elapsed:0.004 Oct 16 01:06:33.429631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:33.432177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:513 - port information retrieved. Elapsed:0.008 Oct 16 01:06:33.432521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:34.997556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port b75f86c7-a0ac-43e2-8da9-10f736efe195 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:34.998190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b75f86c7-a0ac-43e2-8da9-10f736efe195), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:35.424854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:514 started Oct 16 01:06:35.427367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417000,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=70000000,duration_sec=1062,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:35.427950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:35.428898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:514 - starting polling. Elapsed:0.004 Oct 16 01:06:35.431131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:35.433664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:514 - port information retrieved. Elapsed:0.009 Oct 16 01:06:35.434005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:37.143412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port b75f86c7-a0ac-43e2-8da9-10f736efe195 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:06:37.144085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (b75f86c7-a0ac-43e2-8da9-10f736efe195), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:37.426129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:515 started Oct 16 01:06:37.429328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417002,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=72000000,duration_sec=1064,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:37.429950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:37.430239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:515 - starting polling. Elapsed:0.004 Oct 16 01:06:37.432432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:06:37.435008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:515 - port information retrieved. Elapsed:0.009 Oct 16 01:06:37.435353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:06:39.426900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:516 started Oct 16 01:06:39.431300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417004,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=74000000,duration_sec=1066,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:39.431879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:39.432241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Oct 16 01:06:41.428147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:517 started Oct 16 01:06:41.431534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417006,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=74000000,duration_sec=1068,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:41.432272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:41.432695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:06:43.428699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:518 started Oct 16 01:06:43.431580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417008,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=74000000,duration_sec=1070,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:43.432161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:43.432512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:45.430057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:519 started Oct 16 01:06:45.432483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941700a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=76000000,duration_sec=1072,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:45.433038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:45.433386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:47.431473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:520 started Oct 16 01:06:47.433919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941700c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=77000000,duration_sec=1074,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:47.434603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:47.434993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:49.432739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:521 started Oct 16 01:06:49.435184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941700e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=78000000,duration_sec=1076,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:49.435745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:49.436100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:51.434255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:522 started Oct 16 01:06:51.436678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417010,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=80000000,duration_sec=1078,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:51.437270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:51.437803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:53.434883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:523 started Oct 16 01:06:53.437494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417012,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=80000000,duration_sec=1080,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:53.438059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:53.438416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:55.435642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:524 started Oct 16 01:06:55.438043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417014,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=81000000,duration_sec=1082,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:55.438701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:55.439081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:57.437009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:525 started Oct 16 01:06:57.439469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417016,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=82000000,duration_sec=1084,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:57.440064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:57.440439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:06:59.437578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:526 started Oct 16 01:06:59.440002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417018,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=83000000,duration_sec=1086,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:06:59.440785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:06:59.441171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:01.438898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:527 started Oct 16 01:07:01.441341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941701a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=84000000,duration_sec=1088,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:01.441908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:01.442272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:03.440123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:528 started Oct 16 01:07:03.443260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941701c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=86000000,duration_sec=1090,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:03.443777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:03.444531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:05.441655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:529 started Oct 16 01:07:05.445086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941701e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=88000000,duration_sec=1092,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:05.445653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:05.446006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:07:06.917798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cf872488-e762-4ba3-981a-570cd817ddc0 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Resource Port deleted: 030acd90-8e8f-444f-b83a-e384f9ea5bce {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:06.918449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cf872488-e762-4ba3-981a-570cd817ddc0 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (030acd90-8e8f-444f-b83a-e384f9ea5bce), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:06.918573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-cf872488-e762-4ba3-981a-570cd817ddc0 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Security group member updated {'db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'} Oct 16 01:07:07.443361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:530 started Oct 16 01:07:07.446007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417020,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=89000000,duration_sec=1094,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:07.446582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:07.446961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:530 - starting polling. Elapsed:0.004 Oct 16 01:07:07.448980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:07.450344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 030acd90-8e8f-444f-b83a-e384f9ea5bce not present in bridge br-int Oct 16 01:07:07.450684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:07.451007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['030acd90-8e8f-444f-b83a-e384f9ea5bce'] Oct 16 01:07:07.451333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 030acd90-8e8f-444f-b83a-e384f9ea5bce is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:07.453807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:530 - port information retrieved. Elapsed:0.011 Oct 16 01:07:07.454151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 01:07:09.443720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:531 started Oct 16 01:07:09.446351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417022,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=89000000,duration_sec=1096,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:09.446953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:09.447314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:11.445481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:532 started Oct 16 01:07:11.447886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417024,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=91000000,duration_sec=1098,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:11.448452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:11.448808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:13.446317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:533 started Oct 16 01:07:13.448754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417026,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=92000000,duration_sec=1100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:13.449320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:13.449674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:15.446793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:534 started Oct 16 01:07:15.449233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417028,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=92000000,duration_sec=1102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:15.449811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:15.450170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:17.447451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:535 started Oct 16 01:07:17.449849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941702a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=93000000,duration_sec=1104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:17.450416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:17.450782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:07:19.448609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:536 started Oct 16 01:07:19.451081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941702c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=94000000,duration_sec=1106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:19.451661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:19.452019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:20.400466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-56e74a86-572e-4b9e-afaa-24d3ed3b8eef tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-10-16T01:07:20Z,data_plane_status=None,description='',device_id='38ce2d6c-6685-47ba-954e-94c647f15f86',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=31064445-732b-4b77-9363-f66edf178073,mac_address=fa:16:3e:0a:d6:91,name='',network_id=00f07626-fa08-4fe1-b8db-0b77245228f3,numa_affinity_policy=,project_id='c322a47bb2364c8ea9250a7ecea537bf',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(31064445-732b-4b77-9363-f66edf178073),security_group_ids=set([db2762ca-4e2b-467c-b3dc-a74eeffcc3d3]),status='DOWN',updated_at=2022-10-16T01:07:20Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:07:20.400855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-56e74a86-572e-4b9e-afaa-24d3ed3b8eef tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (31064445-732b-4b77-9363-f66edf178073), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:20.401837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-56e74a86-572e-4b9e-afaa-24d3ed3b8eef tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Security group member updated {'db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'} Oct 16 01:07:21.202499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0e1c1cbf-6119-4469-8898-87504c79424c service neutron] Resource Port 31064445-732b-4b77-9363-f66edf178073 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=31064445-732b-4b77-9363-f66edf178073,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=31064445-732b-4b77-9363-f66edf178073,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:07:21.203223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0e1c1cbf-6119-4469-8898-87504c79424c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (31064445-732b-4b77-9363-f66edf178073), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:21.449299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:537 started Oct 16 01:07:21.453807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941702e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=96000000,duration_sec=1108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:21.454447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:21.454986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:537 - starting polling. Elapsed:0.006 Oct 16 01:07:21.456966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:21.459538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:537 - port information retrieved. Elapsed:0.010 Oct 16 01:07:21.459872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Oct 16 01:07:21.482633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0e1c1cbf-6119-4469-8898-87504c79424c service neutron] Resource Port 31064445-732b-4b77-9363-f66edf178073 updated (revision_number 2->3). Old fields: {'binding_levels': [], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=31064445-732b-4b77-9363-f66edf178073,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=31064445-732b-4b77-9363-f66edf178073,segment=NetworkSegment(ce390ca2-87a7-430c-b04c-11a2884592e0),segment_id=ce390ca2-87a7-430c-b04c-11a2884592e0)], 'bindings': [PortBinding(host='hv-cinder-maste',port_id=31064445-732b-4b77-9363-f66edf178073,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')]} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:07:21.483109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0e1c1cbf-6119-4469-8898-87504c79424c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (31064445-732b-4b77-9363-f66edf178073), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:23.450226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:538 started Oct 16 01:07:23.453213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417030,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=96000000,duration_sec=1110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:23.454085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:23.454652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:538 - starting polling. Elapsed:0.005 Oct 16 01:07:23.457243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:23.460162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:538 - port information retrieved. Elapsed:0.010 Oct 16 01:07:23.460624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 01:07:25.451545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:539 started Oct 16 01:07:25.457759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417032,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=101000000,duration_sec=1112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:25.458303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:25.458654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Oct 16 01:07:25.724411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 31064445-732b-4b77-9363-f66edf178073 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:07:25.724793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (31064445-732b-4b77-9363-f66edf178073), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:27.452384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:540 started Oct 16 01:07:27.454908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417034,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=98000000,duration_sec=1114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:27.455484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:27.455825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:540 - starting polling. Elapsed:0.004 Oct 16 01:07:27.457803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:27.460369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:540 - port information retrieved. Elapsed:0.008 Oct 16 01:07:27.460704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:07:27.705710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Resource Port 31064445-732b-4b77-9363-f66edf178073 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Oct 16 01:07:27.706094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-20278026-1857-4c2e-8d9b-bf5e053d0083 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-867288'] for Port (31064445-732b-4b77-9363-f66edf178073), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:29.453530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:541 started Oct 16 01:07:29.456181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417036,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=99000000,duration_sec=1116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:29.456786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:29.457105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:541 - starting polling. Elapsed:0.004 Oct 16 01:07:29.459465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:29.462395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:541 - port information retrieved. Elapsed:0.009 Oct 16 01:07:29.463509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 01:07:31.454354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:542 started Oct 16 01:07:31.457157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417038,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=100000000,duration_sec=1118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:31.457735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:31.458090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:33.455373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:543 started Oct 16 01:07:33.457817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941703a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=101000000,duration_sec=1120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:33.458391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:33.458747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:35.456734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:544 started Oct 16 01:07:35.459214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941703c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=102000000,duration_sec=1122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:35.459789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:35.460145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:36.093751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4a5f5feb-7012-4c27-b67d-74bd51007af8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port deleted: 4421e167-6168-4c78-9293-a1d72e2e60b0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:36.094135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4a5f5feb-7012-4c27-b67d-74bd51007af8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (4421e167-6168-4c78-9293-a1d72e2e60b0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:37.458130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:545 started Oct 16 01:07:37.461403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941703e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=104000000,duration_sec=1124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:37.461977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:37.462349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:545 - starting polling. Elapsed:0.004 Oct 16 01:07:37.464393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:37.465739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4421e167-6168-4c78-9293-a1d72e2e60b0 not present in bridge br-int Oct 16 01:07:37.466294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:37.466720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['4421e167-6168-4c78-9293-a1d72e2e60b0'] Oct 16 01:07:37.467081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 4421e167-6168-4c78-9293-a1d72e2e60b0 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:37.469566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:545 - port information retrieved. Elapsed:0.012 Oct 16 01:07:37.469909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 16 01:07:39.459000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:546 started Oct 16 01:07:39.461430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417040,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=104000000,duration_sec=1126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:39.462504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:39.462882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:41.451911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee5d3657-7f08-4321-8be6-e8312793fbe8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port deleted: 8650d000-9eba-4333-85df-35ab0580d9c1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:41.452837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee5d3657-7f08-4321-8be6-e8312793fbe8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (8650d000-9eba-4333-85df-35ab0580d9c1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:41.452837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee5d3657-7f08-4321-8be6-e8312793fbe8 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group member updated {'04a6f405-fb32-4245-a68e-14ecec65861c'} Oct 16 01:07:41.459503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:547 started Oct 16 01:07:41.463469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417042,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=105000000,duration_sec=1128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:41.464110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:41.464672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:547 - starting polling. Elapsed:0.005 Oct 16 01:07:41.466922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:41.468330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 8650d000-9eba-4333-85df-35ab0580d9c1 not present in bridge br-int Oct 16 01:07:41.468673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:41.468965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['8650d000-9eba-4333-85df-35ab0580d9c1'] Oct 16 01:07:41.471347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 8650d000-9eba-4333-85df-35ab0580d9c1 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:41.474612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:547 - port information retrieved. Elapsed:0.015 Oct 16 01:07:41.475006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Oct 16 01:07:43.460828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:548 started Oct 16 01:07:43.463433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417044,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=106000000,duration_sec=1130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:43.464036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:43.464424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:45.461617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:549 started Oct 16 01:07:45.464578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417046,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=108000000,duration_sec=1132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:45.465149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:45.465499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:47.462572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:550 started Oct 16 01:07:47.465594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417048,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=109000000,duration_sec=1134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:47.466163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:47.466524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:07:48.818990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-148660f7-3f09-46b1-9c8c-449fae98f12d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port deleted: 6923da62-5c1b-4339-9ea8-d2c3c6c29548 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:48.819690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-148660f7-3f09-46b1-9c8c-449fae98f12d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (6923da62-5c1b-4339-9ea8-d2c3c6c29548), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:49.464120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:551 started Oct 16 01:07:49.467214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941704a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=110000000,duration_sec=1136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:49.467773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:49.468117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:551 - starting polling. Elapsed:0.004 Oct 16 01:07:49.470127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:49.471503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6923da62-5c1b-4339-9ea8-d2c3c6c29548 not present in bridge br-int Oct 16 01:07:49.471845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:49.472139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['6923da62-5c1b-4339-9ea8-d2c3c6c29548'] Oct 16 01:07:49.472467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6923da62-5c1b-4339-9ea8-d2c3c6c29548 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:49.475032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:551 - port information retrieved. Elapsed:0.011 Oct 16 01:07:49.475370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Oct 16 01:07:51.465806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:552 started Oct 16 01:07:51.469687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941704c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=111000000,duration_sec=1138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:51.470277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:51.470982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:07:52.069980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-fdc2084c-f692-4d69-be88-86ee959bdc8d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port deleted: ea701c3f-eb65-4a82-83d0-b757b0f39524 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:52.069980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-fdc2084c-f692-4d69-be88-86ee959bdc8d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (ea701c3f-eb65-4a82-83d0-b757b0f39524), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:52.070399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-fdc2084c-f692-4d69-be88-86ee959bdc8d tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group member updated {'04a6f405-fb32-4245-a68e-14ecec65861c'} Oct 16 01:07:53.466910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:553 started Oct 16 01:07:53.470745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941704e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=113000000,duration_sec=1140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:53.471360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:53.471705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:553 - starting polling. Elapsed:0.005 Oct 16 01:07:53.473751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:53.475403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ea701c3f-eb65-4a82-83d0-b757b0f39524 not present in bridge br-int Oct 16 01:07:53.475743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:53.476034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['ea701c3f-eb65-4a82-83d0-b757b0f39524'] Oct 16 01:07:53.476386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port ea701c3f-eb65-4a82-83d0-b757b0f39524 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:53.479555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:553 - port information retrieved. Elapsed:0.013 Oct 16 01:07:53.479940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Oct 16 01:07:53.931410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b52f3e8c-e427-4588-9f93-59458fb88538 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Resource Port deleted: 31064445-732b-4b77-9363-f66edf178073 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:53.931791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b52f3e8c-e427-4588-9f93-59458fb88538 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (31064445-732b-4b77-9363-f66edf178073), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:53.932205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-b52f3e8c-e427-4588-9f93-59458fb88538 tempest-VolumesSnapshotTestJSON-799418870 tempest-VolumesSnapshotTestJSON-799418870-project] Security group member updated {'db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'} Oct 16 01:07:54.861497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ef259c05-2a85-4370-b116-d6e86f74fc55 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource Port deleted: 1f2f9447-5a26-405e-829d-d6cb41d3ad8d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:54.862238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ef259c05-2a85-4370-b116-d6e86f74fc55 tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (1f2f9447-5a26-405e-829d-d6cb41d3ad8d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:55.467543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:554 started Oct 16 01:07:55.470083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417050,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=113000000,duration_sec=1142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:55.470696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:55.471105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:554 - starting polling. Elapsed:0.004 Oct 16 01:07:55.473203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:55.474752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 31064445-732b-4b77-9363-f66edf178073 not present in bridge br-int Oct 16 01:07:55.475133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:55.476390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1f2f9447-5a26-405e-829d-d6cb41d3ad8d not present in bridge br-int Oct 16 01:07:55.476723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:55.477016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['1f2f9447-5a26-405e-829d-d6cb41d3ad8d', '31064445-732b-4b77-9363-f66edf178073'] Oct 16 01:07:55.477352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 1f2f9447-5a26-405e-829d-d6cb41d3ad8d is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:55.477657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 31064445-732b-4b77-9363-f66edf178073 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:55.480482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:554 - port information retrieved. Elapsed:0.013 Oct 16 01:07:55.480933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Oct 16 01:07:56.321292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroup deleted: 04a6f405-fb32-4245-a68e-14ecec65861c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.322162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (04a6f405-fb32-4245-a68e-14ecec65861c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.322440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('04a6f405-fb32-4245-a68e-14ecec65861c',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:07:56.339820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('04a6f405-fb32-4245-a68e-14ecec65861c',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:07:56.340725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: 097610ca-40ff-4e1d-84b1-0c6b0e68c83e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.341464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (097610ca-40ff-4e1d-84b1-0c6b0e68c83e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.341801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.342196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: 4ca20f0b-9143-4b3f-8784-ef19af3588e8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.342543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4ca20f0b-9143-4b3f-8784-ef19af3588e8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.342879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.343412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: b3dc21cc-c421-4382-a102-8b8b5597fcea {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.345281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b3dc21cc-c421-4382-a102-8b8b5597fcea), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.345281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.345281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: daec3887-43a8-4593-ac89-8d9e89eda5b7 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.345281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (daec3887-43a8-4593-ac89-8d9e89eda5b7), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.352873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.352873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: fb39c3de-042c-4f25-ba24-bf43005a63e0 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.352873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fb39c3de-042c-4f25-ba24-bf43005a63e0), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.352873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.352873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: 43eb4dbc-c451-46db-913f-9a8edce4ac84 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.353798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (43eb4dbc-c451-46db-913f-9a8edce4ac84), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.353798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.353798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: 9f6e1d9d-a90d-4c5d-948d-493d9d4f27f8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.353798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9f6e1d9d-a90d-4c5d-948d-493d9d4f27f8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.354125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:56.354125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Resource SecurityGroupRule deleted: f4c1e8d2-b78e-4cb5-ac43-38df20648003 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:56.354125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f4c1e8d2-b78e-4cb5-ac43-38df20648003), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:56.354125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-6c7241ec-fa73-43ed-8184-b443899dd22c tempest-TestVolumeBootPattern-1252253557 tempest-TestVolumeBootPattern-1252253557-project] Security group rule updated ['04a6f405-fb32-4245-a68e-14ecec65861c'] Oct 16 01:07:57.365331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-cde66d30-cecc-4f2d-a007-3f9590ca1d80 admin admin] Resource Port deleted: d6141001-454c-4247-9f8c-c8bedfbcc602 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:57.366376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-cde66d30-cecc-4f2d-a007-3f9590ca1d80 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (d6141001-454c-4247-9f8c-c8bedfbcc602), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:57.468533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:555 started Oct 16 01:07:57.471520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417052,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=114000000,duration_sec=1144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:57.472407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:57.472758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:555 - starting polling. Elapsed:0.004 Oct 16 01:07:57.474826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:57.479358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d6141001-45, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:07:57.491481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417054,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:57.492228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['d6141001-454c-4247-9f8c-c8bedfbcc602'] Oct 16 01:07:57.492975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:07:57.555904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b64e19b-11f3-47dc-bf3d-3f9d8487213a]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:07:57.561099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:555 - port information retrieved. Elapsed:0.093 Oct 16 01:07:57.561824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.093 Oct 16 01:07:58.589684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["14e2c558-1c55-4d88-a1df-022b3d9d9a0c","delete","qr-d6141001-45",20,["map",[["attached-mac","fa:16:3e:67:c9:31"],["iface-id","d6141001-454c-4247-9f8c-c8bedfbcc602"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:07:58.864605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ff8cf53d-c389-4123-b252-3a7184af5521 admin admin] Resource Port deleted: 4499fdb3-16a3-4c5e-94f1-07baf827edcb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:58.865158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ff8cf53d-c389-4123-b252-3a7184af5521 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (4499fdb3-16a3-4c5e-94f1-07baf827edcb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:59.031118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["86318794-68e3-4f6e-9a67-47f8570ab573","delete","qg-4499fdb3-16",19,["map",[["attached-mac","fa:16:3e:a1:f1:bc"],["iface-id","4499fdb3-16a3-4c5e-94f1-07baf827edcb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:07:59.401324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-b113166e-5661-4d4b-9180-86dbfa275259 admin admin] Resource Subnet deleted: 85abdef7-ce07-4fe0-b80f-da308604c12a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:59.402128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-b113166e-5661-4d4b-9180-86dbfa275259 admin admin] Publish callbacks [] for Subnet (85abdef7-ce07-4fe0-b80f-da308604c12a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:59.469651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:556 started Oct 16 01:07:59.472558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417056,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=115000000,duration_sec=1146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:59.473600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:07:59.474066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:556 - starting polling. Elapsed:0.005 Oct 16 01:07:59.476407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:07:59.480914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417058,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:59.482976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7941705a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:07:59.483513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:556 - port information retrieved. Elapsed:0.014 Oct 16 01:07:59.483856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', '54484db5-9b23-44a4-aeef-b1d117e40429', 'a0f3de46-77fa-4767-8d04-a86666829119', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'d6141001-454c-4247-9f8c-c8bedfbcc602', '4499fdb3-16a3-4c5e-94f1-07baf827edcb'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:07:59.484187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:556 - agent port security group processed in 0.000 Oct 16 01:07:59.486138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:07:59.486890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'d6141001-454c-4247-9f8c-c8bedfbcc602', '4499fdb3-16a3-4c5e-94f1-07baf827edcb'} Oct 16 01:07:59.487446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port d6141001-454c-4247-9f8c-c8bedfbcc602 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:07:59.488090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:07:59.539663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[82148aca-95fb-4672-8a83-c80b6813d247]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:07:59.540430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'d6141001-454c-4247-9f8c-c8bedfbcc602', '4499fdb3-16a3-4c5e-94f1-07baf827edcb'} removed Oct 16 01:07:59.587246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6f79d52d-ed97-441c-9527-073ff9341ea5","delete","tap54484db5-9b",18,["map",[["attached-mac","fa:16:3e:a2:32:97"],["iface-id","54484db5-9b23-44a4-aeef-b1d117e40429"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:07:59.756586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:07:59.756586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:07:59.757619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:556 - treat_devices_removed completed in 0.270 Oct 16 01:07:59.757619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:556 - ports processed. Elapsed:0.288 Oct 16 01:07:59.757871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.288 Oct 16 01:07:59.768305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ed289f5d-81d9-45ec-970a-73206abe2d40 admin admin] Resource Port deleted: 54484db5-9b23-44a4-aeef-b1d117e40429 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:07:59.769632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ed289f5d-81d9-45ec-970a-73206abe2d40 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (54484db5-9b23-44a4-aeef-b1d117e40429), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:00.108488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ed289f5d-81d9-45ec-970a-73206abe2d40 admin admin] Resource Network deleted: 67400858-429f-4052-a9a5-3012690406d5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:00.108877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ed289f5d-81d9-45ec-970a-73206abe2d40 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (67400858-429f-4052-a9a5-3012690406d5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:01.001021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-aee364a0-ebe4-48cd-9bb3-af54d28d4cfc admin admin] Resource Port deleted: 6602cfc3-b450-43d0-b2b3-391416a4e3fb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:01.001796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-aee364a0-ebe4-48cd-9bb3-af54d28d4cfc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (6602cfc3-b450-43d0-b2b3-391416a4e3fb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:01.470749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:557 started Oct 16 01:08:01.473262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941705c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=116000000,duration_sec=1148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:01.474005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:01.474641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:557 - starting polling. Elapsed:0.004 Oct 16 01:08:01.476542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:01.479765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6602cfc3-b4, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:08:01.497783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7941705e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:01.498194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['6602cfc3-b450-43d0-b2b3-391416a4e3fb'] Oct 16 01:08:01.498651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:08:01.562819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc341cb-0571-4733-8b03-541d19f2cf41]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:08:01.569955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417060,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:01.569955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:557 - port information retrieved. Elapsed:0.097 Oct 16 01:08:01.569955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a0f3de46-77fa-4767-8d04-a86666829119', '6602cfc3-b450-43d0-b2b3-391416a4e3fb', '58159a88-5783-4e48-abef-6853eb73d938', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'54484db5-9b23-44a4-aeef-b1d117e40429'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:08:01.570262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:557 - agent port security group processed in 0.000 Oct 16 01:08:01.570787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:08:01.571095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'54484db5-9b23-44a4-aeef-b1d117e40429'} Oct 16 01:08:01.572524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:08:01.628231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dee675-de91-40b1-95f0-37a872a87ebd]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:08:01.629112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'54484db5-9b23-44a4-aeef-b1d117e40429'} removed Oct 16 01:08:01.684209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:08:01.685269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 8 from net-id = 67400858-429f-4052-a9a5-3012690406d5, seg-id = 351 Oct 16 01:08:01.691007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8ca9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:01.702484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79417062,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4447}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:01.703362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:557 - treat_devices_removed completed in 0.132 Oct 16 01:08:01.704062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:557 - ports processed. Elapsed:0.233 Oct 16 01:08:01.704780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.234 Oct 16 01:08:02.329730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["97fc4565-ea40-4134-9c04-3ea92d4896fa","delete","qr-6602cfc3-b4",23,["map",[["attached-mac","fa:16:3e:30:b1:52"],["iface-id","6602cfc3-b450-43d0-b2b3-391416a4e3fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:08:02.369688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4744d62e-601e-411a-ab98-ee564dd7250e admin admin] Resource Port deleted: 70290c51-f188-4c1e-8e6c-a1cdcf26ed1a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:02.370107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4744d62e-601e-411a-ab98-ee564dd7250e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (70290c51-f188-4c1e-8e6c-a1cdcf26ed1a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:02.739212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ed6142c3-7300-4b39-8784-9c5b1547c2d4","delete","qg-70290c51-f1",22,["map",[["attached-mac","fa:16:3e:64:8c:e7"],["iface-id","70290c51-f188-4c1e-8e6c-a1cdcf26ed1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:08:03.131805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9d3e262d-9df1-474f-94b2-21bc3ad281dc admin admin] Resource Subnet deleted: 67eb960f-e877-4e93-8af8-8f120433934d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:03.132428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9d3e262d-9df1-474f-94b2-21bc3ad281dc admin admin] Publish callbacks [] for Subnet (67eb960f-e877-4e93-8af8-8f120433934d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:03.318057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["cfa81f0a-2611-48cd-8003-1d833cdf6c0f","delete","tap58159a88-57",21,["map",[["attached-mac","fa:16:3e:41:fc:7d"],["iface-id","58159a88-5783-4e48-abef-6853eb73d938"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:08:03.472411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:558 started Oct 16 01:08:03.480422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417064,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=119000000,duration_sec=1150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:03.483585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:03.484551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:558 - starting polling. Elapsed:0.012 Oct 16 01:08:03.486290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:03.501517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417066,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:03.515377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417068,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:03.517884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7941706a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:03.518124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:558 - port information retrieved. Elapsed:0.046 Oct 16 01:08:03.518940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'a0f3de46-77fa-4767-8d04-a86666829119', 'fe94c5f2-dc80-4270-a160-f6fab75a087e', 'd48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e'}, 'added': set(), 'removed': {'6602cfc3-b450-43d0-b2b3-391416a4e3fb', '58159a88-5783-4e48-abef-6853eb73d938', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:08:03.518940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:558 - agent port security group processed in 0.000 Oct 16 01:08:03.520475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:08:03.520898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'6602cfc3-b450-43d0-b2b3-391416a4e3fb', '58159a88-5783-4e48-abef-6853eb73d938', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'} Oct 16 01:08:03.521525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 6602cfc3-b450-43d0-b2b3-391416a4e3fb is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:08:03.522710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:08:03.581267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[546dbe92-c643-423e-a1e7-11963c106ec8]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:08:03.581805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'6602cfc3-b450-43d0-b2b3-391416a4e3fb', '58159a88-5783-4e48-abef-6853eb73d938', '70290c51-f188-4c1e-8e6c-a1cdcf26ed1a'} removed Oct 16 01:08:03.589389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1040a4f0-c4f6-4494-990f-da31cced4675 admin admin] Resource Port deleted: 58159a88-5783-4e48-abef-6853eb73d938 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:03.590216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1040a4f0-c4f6-4494-990f-da31cced4675 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (58159a88-5783-4e48-abef-6853eb73d938), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:03.681640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:08:03.682383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:08:03.682963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 9 from net-id = 3ddf9fc6-b7ec-4894-844e-44f84b7c3b07, seg-id = 398 Oct 16 01:08:03.686036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8cab,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:03.689997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7941706c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4494}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:03.690568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:558 - treat_devices_removed completed in 0.170 Oct 16 01:08:03.691085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:558 - ports processed. Elapsed:0.219 Oct 16 01:08:03.691567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.220 Oct 16 01:08:03.722974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7c7cbd88-97a4-4b7a-8b90-1de598e1cb95 None None] Resource Port deleted: 58159a88-5783-4e48-abef-6853eb73d938 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:03.723464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-7c7cbd88-97a4-4b7a-8b90-1de598e1cb95 None None] Skipped duplicate delete event for 58159a88-5783-4e48-abef-6853eb73d938 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Oct 16 01:08:03.828932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1040a4f0-c4f6-4494-990f-da31cced4675 admin admin] Resource Network deleted: 3ddf9fc6-b7ec-4894-844e-44f84b7c3b07 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:03.829320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1040a4f0-c4f6-4494-990f-da31cced4675 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (3ddf9fc6-b7ec-4894-844e-44f84b7c3b07), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.129044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Resource SecurityGroup deleted: 8fe3bf74-e019-4454-9cfb-63e09082d849 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.129426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (8fe3bf74-e019-4454-9cfb-63e09082d849), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.130124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8fe3bf74-e019-4454-9cfb-63e09082d849',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:04.145764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8fe3bf74-e019-4454-9cfb-63e09082d849',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:04.146548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Resource SecurityGroupRule deleted: 002adbfb-b43e-4ace-b6c8-ab7a228e489a {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.147106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (002adbfb-b43e-4ace-b6c8-ab7a228e489a), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.147457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 01:08:04.147863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Resource SecurityGroupRule deleted: 0a3df241-6bc6-4b12-aa56-062a314d77a6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.148224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0a3df241-6bc6-4b12-aa56-062a314d77a6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.148557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 01:08:04.148948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Resource SecurityGroupRule deleted: af85e82a-49a7-4419-99c4-1a3caf05c50b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.149297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (af85e82a-49a7-4419-99c4-1a3caf05c50b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.149627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 01:08:04.150490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Resource SecurityGroupRule deleted: b22d0823-0fa5-4507-8e96-f68d40e9f149 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.150838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b22d0823-0fa5-4507-8e96-f68d40e9f149), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.151193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a3bf2d5c-34b7-463c-9a86-becd7350d09f admin admin] Security group rule updated ['8fe3bf74-e019-4454-9cfb-63e09082d849'] Oct 16 01:08:04.697701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Resource SecurityGroup deleted: 4daccf5d-b1df-47b4-9c00-4a60f28fb466 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.698287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (4daccf5d-b1df-47b4-9c00-4a60f28fb466), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.698646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4daccf5d-b1df-47b4-9c00-4a60f28fb466',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:04.713117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4daccf5d-b1df-47b4-9c00-4a60f28fb466',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:04.713698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Resource SecurityGroupRule deleted: 41b3c0a0-069e-46b4-b4a7-60aa318e1e74 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.714086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (41b3c0a0-069e-46b4-b4a7-60aa318e1e74), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.714425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 01:08:04.714817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Resource SecurityGroupRule deleted: 627f4884-3fe2-4159-9ed0-8401a94e8d74 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.715373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (627f4884-3fe2-4159-9ed0-8401a94e8d74), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.715701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 01:08:04.716076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Resource SecurityGroupRule deleted: 8425f475-9b79-47b5-8086-d4f9d5d854a3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.716518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8425f475-9b79-47b5-8086-d4f9d5d854a3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.716730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 01:08:04.717102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Resource SecurityGroupRule deleted: c122298e-0bba-4314-bdf0-52d2ee66589c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:04.717445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c122298e-0bba-4314-bdf0-52d2ee66589c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:04.717763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ac488088-eaf6-4ac8-861c-735a606e4595 admin admin] Security group rule updated ['4daccf5d-b1df-47b4-9c00-4a60f28fb466'] Oct 16 01:08:05.473386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:559 started Oct 16 01:08:05.476394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941706e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=119000000,duration_sec=1152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:05.476990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:05.477349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:559 - starting polling. Elapsed:0.004 Oct 16 01:08:05.478823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:05.479817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 58159a88-5783-4e48-abef-6853eb73d938 not present in bridge br-int Oct 16 01:08:05.480160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:08:05.480459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['58159a88-5783-4e48-abef-6853eb73d938'] Oct 16 01:08:05.480790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port 58159a88-5783-4e48-abef-6853eb73d938 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:08:05.482498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:559 - port information retrieved. Elapsed:0.009 Oct 16 01:08:05.482846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Oct 16 01:08:07.474665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:560 started Oct 16 01:08:07.477526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417070,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=120000000,duration_sec=1154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:07.478307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:07.478673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:09.476007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:561 started Oct 16 01:08:09.479240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417072,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=122000000,duration_sec=1156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:09.479863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:09.480226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:10.047409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee9f6c0b-3fbd-4636-aab6-a76fd910b94c tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource Port deleted: b75f86c7-a0ac-43e2-8da9-10f736efe195 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:10.047998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee9f6c0b-3fbd-4636-aab6-a76fd910b94c tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (b75f86c7-a0ac-43e2-8da9-10f736efe195), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:10.048410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-ee9f6c0b-3fbd-4636-aab6-a76fd910b94c tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group member updated {'3e390656-dd0d-43cf-8c2e-fdedef30e802'} Oct 16 01:08:11.477246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:562 started Oct 16 01:08:11.479833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417074,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=123000000,duration_sec=1158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:11.480450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:11.480789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:562 - starting polling. Elapsed:0.004 Oct 16 01:08:11.482480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:11.483353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port b75f86c7-a0ac-43e2-8da9-10f736efe195 not present in bridge br-int Oct 16 01:08:11.483687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:08:11.483979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['b75f86c7-a0ac-43e2-8da9-10f736efe195'] Oct 16 01:08:11.484309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port b75f86c7-a0ac-43e2-8da9-10f736efe195 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:08:11.486049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:562 - port information retrieved. Elapsed:0.009 Oct 16 01:08:11.486421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:08:12.417531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroup deleted: 3e390656-dd0d-43cf-8c2e-fdedef30e802 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:12.417915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3e390656-dd0d-43cf-8c2e-fdedef30e802), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:12.418423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3e390656-dd0d-43cf-8c2e-fdedef30e802',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:12.434209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3e390656-dd0d-43cf-8c2e-fdedef30e802',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:12.434731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: 12094663-389a-49a0-b3da-de7506c89df6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:12.435225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (12094663-389a-49a0-b3da-de7506c89df6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:12.435803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:08:12.436360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: fa7acd47-6c6c-4d41-8097-02860e342ed2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:12.437463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (fa7acd47-6c6c-4d41-8097-02860e342ed2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:12.437892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:08:12.438341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: 91d163a8-d119-4a29-9908-24e2e4bd045e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:12.439033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (91d163a8-d119-4a29-9908-24e2e4bd045e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:12.439637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:08:12.440075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource SecurityGroupRule deleted: 00f034a5-7789-44a0-8cd9-d8371407989f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:12.440486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (00f034a5-7789-44a0-8cd9-d8371407989f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:12.440868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-883bef7d-39c3-467d-8897-068059b58135 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Security group rule updated ['3e390656-dd0d-43cf-8c2e-fdedef30e802'] Oct 16 01:08:12.812065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-25af10bb-b92f-4f77-9fa9-7448fc279b81 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Resource Port deleted: e955ac14-5202-4518-b5b9-c5716fee8c28 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:12.812615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-25af10bb-b92f-4f77-9fa9-7448fc279b81 tempest-AttachVolumeTestJSON-860372929 tempest-AttachVolumeTestJSON-860372929-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (e955ac14-5202-4518-b5b9-c5716fee8c28), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:13.478141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:563 started Oct 16 01:08:13.481057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417076,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=124000000,duration_sec=1160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:13.481582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:13.481931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:563 - starting polling. Elapsed:0.004 Oct 16 01:08:13.483443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:13.484411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port e955ac14-5202-4518-b5b9-c5716fee8c28 not present in bridge br-int Oct 16 01:08:13.484747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:08:13.485036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['e955ac14-5202-4518-b5b9-c5716fee8c28'] Oct 16 01:08:13.485386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port e955ac14-5202-4518-b5b9-c5716fee8c28 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:08:13.487077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:563 - port information retrieved. Elapsed:0.009 Oct 16 01:08:13.487416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Oct 16 01:08:15.481714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:564 started Oct 16 01:08:15.484132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417078,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=127000000,duration_sec=1162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:15.484708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:15.485087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:17.440544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-70002065-0ff9-4709-a437-e4dd2bb790a9 admin admin] Resource Port deleted: a0f3de46-77fa-4767-8d04-a86666829119 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:17.441804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-70002065-0ff9-4709-a437-e4dd2bb790a9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (a0f3de46-77fa-4767-8d04-a86666829119), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:17.483174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:565 started Oct 16 01:08:17.486147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941707a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=129000000,duration_sec=1164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:17.486816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:17.487258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:565 - starting polling. Elapsed:0.004 Oct 16 01:08:17.488799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:17.491182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a0f3de46-77, col_values=(('tag', 4095),)) {{(pid=105601) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Oct 16 01:08:17.503957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7941707c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16250737307531889450,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:17.504508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for ['a0f3de46-77fa-4767-8d04-a86666829119'] Oct 16 01:08:17.505156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 4 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:08:17.554815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e2040-6ed9-4ff4-bced-577ce76c9659]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:08:17.557317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:565 - port information retrieved. Elapsed:0.074 Oct 16 01:08:17.557773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.075 Oct 16 01:08:18.526688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c4e93215-80b8-493d-b2a4-cbbbd4ba8bfd admin admin] Resource Subnet deleted: 2719eb6f-42f8-40e2-94fe-1aae0fcee16d {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:18.528294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c4e93215-80b8-493d-b2a4-cbbbd4ba8bfd admin admin] Publish callbacks [] for Subnet (2719eb6f-42f8-40e2-94fe-1aae0fcee16d), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:18.543126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-99c3e459-7a2b-4e31-be76-d46514917390 admin admin] Resource Port deleted: d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:18.543752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-99c3e459-7a2b-4e31-be76-d46514917390 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:18.718375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["163eb689-4fcd-4693-aca7-6425d9173f02","delete","qr-a0f3de46-77",37,["map",[["attached-mac","fa:16:3e:0a:6f:90"],["iface-id","a0f3de46-77fa-4767-8d04-a86666829119"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:08:18.872746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-ee26670d-f549-4e23-9ef6-72ee49e2d3f1 admin admin] Resource Network deleted: 00f07626-fa08-4fe1-b8db-0b77245228f3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:18.873147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-ee26670d-f549-4e23-9ef6-72ee49e2d3f1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (00f07626-fa08-4fe1-b8db-0b77245228f3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.030462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d13179ed-53c6-4afd-aaa5-f596b41fba6e admin admin] Resource Subnet deleted: ddb48e42-3d61-453a-90ed-9d67363fcb4f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.044328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d13179ed-53c6-4afd-aaa5-f596b41fba6e admin admin] Publish callbacks [] for Subnet (ddb48e42-3d61-453a-90ed-9d67363fcb4f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.193588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d1f1c75f-4f7c-46e4-8bc3-58bc7e221981","delete","qg-d48c3a5e-a5",38,["map",[["attached-mac","fa:16:3e:74:73:64"],["iface-id","d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:08:19.202231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["42b6ceae-84a9-4ec0-a981-e00037c14331","delete","tap3fff1000-da",36,["map",[["attached-mac","fa:16:3e:79:43:9e"],["iface-id","3fff1000-da0b-466d-9856-c4fcdcbd4c2e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=105601) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Oct 16 01:08:19.214675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Resource SecurityGroup deleted: db2762ca-4e2b-467c-b3dc-a74eeffcc3d3 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.215977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (db2762ca-4e2b-467c-b3dc-a74eeffcc3d3), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.216483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('db2762ca-4e2b-467c-b3dc-a74eeffcc3d3',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:19.230964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('db2762ca-4e2b-467c-b3dc-a74eeffcc3d3',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:19.231541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Resource SecurityGroupRule deleted: 2d6ab514-2d23-40bb-9708-fe361aac1838 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.232014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2d6ab514-2d23-40bb-9708-fe361aac1838), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.232458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:08:19.232984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Resource SecurityGroupRule deleted: 3c7a3de8-318b-4994-83a1-d6e09e4840df {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.234114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3c7a3de8-318b-4994-83a1-d6e09e4840df), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.234581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:08:19.235088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Resource SecurityGroupRule deleted: c4d84dcb-2be2-4ea3-bfb2-9d8f4252e1ef {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.236101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c4d84dcb-2be2-4ea3-bfb2-9d8f4252e1ef), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.236533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:08:19.237014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Resource SecurityGroupRule deleted: e9b1038b-d01a-4e69-96f8-f7ee067e9bc4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.237734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (e9b1038b-d01a-4e69-96f8-f7ee067e9bc4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.238610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-2f93ff3c-a32e-40b7-9d17-8f20490c5c6d admin admin] Security group rule updated ['db2762ca-4e2b-467c-b3dc-a74eeffcc3d3'] Oct 16 01:08:19.397419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-511c8c0d-8943-49ae-928e-56d1d6ab17a8 admin admin] Resource Port deleted: 3fff1000-da0b-466d-9856-c4fcdcbd4c2e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.397991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-511c8c0d-8943-49ae-928e-56d1d6ab17a8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-867287'] for Port (3fff1000-da0b-466d-9856-c4fcdcbd4c2e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.484313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:566 started Oct 16 01:08:19.502890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941707e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=137000000,duration_sec=1166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:19.503485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:19.504343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:566 - starting polling. Elapsed:0.020 Oct 16 01:08:19.505842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-902497'] for ovsdb (None), after_read {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.533165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417080,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:19.539533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417082,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:19.542269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x79417084,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:19.542596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:566 - port information retrieved. Elapsed:0.058 Oct 16 01:08:19.543621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Starting to process devices in:{'current': {'ed38c648-5564-48a0-9570-e3a7eef6b8a2', 'ba42d6fc-7741-4305-8222-15c7960340e2', 'bce54c84-34e6-4b14-aaaa-8fc11edd42a4', 'fe94c5f2-dc80-4270-a160-f6fab75a087e'}, 'added': set(), 'removed': {'d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'a0f3de46-77fa-4767-8d04-a86666829119'}, 'updated': set(), 're_added': set()} {{(pid=105601) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Oct 16 01:08:19.543621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:566 - agent port security group processed in 0.000 Oct 16 01:08:19.544375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Configuration for devices up [] and devices down [] completed. Oct 16 01:08:19.544683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Remove device filter for {'d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'a0f3de46-77fa-4767-8d04-a86666829119'} Oct 16 01:08:19.545274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port a0f3de46-77fa-4767-8d04-a86666829119 is not handled by the firewall. {{(pid=105601) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Oct 16 01:08:19.545656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.common.ovs_lib [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Processing 8 OpenFlow rules. {{(pid=105601) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Oct 16 01:08:19.599278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG oslo.privsep.daemon [-] privsep: reply[4424098e-51c6-4d56-9549-1dacfc376f55]: (4, ('', '', 0)) {{(pid=107304) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Oct 16 01:08:19.600203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Ports {'d48c3a5e-a5b6-437b-9b47-0e5512bf4fa8', '3fff1000-da0b-466d-9856-c4fcdcbd4c2e', 'a0f3de46-77fa-4767-8d04-a86666829119'} removed Oct 16 01:08:19.691440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Port removal failed for set() {{(pid=105601) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Oct 16 01:08:19.692284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Reclaiming vlan = 14 from net-id = 57335160-65ed-4241-a862-dbf37da52fd2, seg-id = 359 Oct 16 01:08:19.699018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xd17e8cad,OFPFlowMod(buffer_id=4294967295,command=3,cookie=3824201269964127989,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:19.700301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-511c8c0d-8943-49ae-928e-56d1d6ab17a8 admin admin] Resource Network deleted: 57335160-65ed-4241-a862-dbf37da52fd2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:19.700846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-511c8c0d-8943-49ae-928e-56d1d6ab17a8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-203106'] for Network (57335160-65ed-4241-a862-dbf37da52fd2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:19.709764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x79417086,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16250737307531889450,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4455}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:19.710133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] net_uuid None not managed by VLAN manager Oct 16 01:08:19.710440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] process_network_ports - iteration:566 - treat_devices_removed completed in 0.166 Oct 16 01:08:19.710733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:566 - ports processed. Elapsed:0.227 Oct 16 01:08:19.711098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.227 Oct 16 01:08:20.059874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Resource SecurityGroup deleted: 7a279710-7506-4f0c-bac4-6c2b0f088046 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:20.060345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (7a279710-7506-4f0c-bac4-6c2b0f088046), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:20.060847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7a279710-7506-4f0c-bac4-6c2b0f088046',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:20.074445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7a279710-7506-4f0c-bac4-6c2b0f088046',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:20.074910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Resource SecurityGroupRule deleted: 13acf2b5-a428-4028-84c3-55c31869da29 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:20.075292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (13acf2b5-a428-4028-84c3-55c31869da29), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:20.075635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:08:20.076054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Resource SecurityGroupRule deleted: 36dd0d8a-cf3a-414c-b8fc-5a5181b0176f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:20.076558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (36dd0d8a-cf3a-414c-b8fc-5a5181b0176f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:20.076894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:08:20.077274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Resource SecurityGroupRule deleted: c661cf59-5106-4b36-8e2f-a39709112515 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:20.077624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c661cf59-5106-4b36-8e2f-a39709112515), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:20.077950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:08:20.078324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Resource SecurityGroupRule deleted: dc2fec1f-48eb-42c8-8e23-5192509b6379 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:20.078670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (dc2fec1f-48eb-42c8-8e23-5192509b6379), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:20.079055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-bf965c16-0410-4209-9674-19e609ff97e8 admin admin] Security group rule updated ['7a279710-7506-4f0c-bac4-6c2b0f088046'] Oct 16 01:08:21.485612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:567 started Oct 16 01:08:21.488121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417088,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=131000000,duration_sec=1168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:21.488756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:21.489123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:23.487056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:568 started Oct 16 01:08:23.489430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941708a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=133000000,duration_sec=1170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:23.489997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:23.490360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:25.488125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:569 started Oct 16 01:08:25.490404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941708c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=134000000,duration_sec=1172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:25.491002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:25.491352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:27.489401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:570 started Oct 16 01:08:27.492157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941708e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=135000000,duration_sec=1174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:27.492767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:27.493477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:29.491014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:571 started Oct 16 01:08:29.494208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417090,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=137000000,duration_sec=1176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:29.495128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:29.495392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:08:29.968941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:08:29Z,description='Default security group',id=affcce94-8013-41bd-94da-0e7cb827031f,is_default=True,name='default',project_id='34db4209796f4261aa01c1f0175e0da0',revision_number=1,rules=[SecurityGroupRule(2626621f-ea00-4fc2-9159-b04ee14f105b),SecurityGroupRule(2b60abc6-ece0-485a-bc44-3018c6d49041),SecurityGroupRule(2c116c67-2b5c-44b6-b460-604143f8bf86),SecurityGroupRule(867971d3-1b74-45c6-bfe9-4ad22d6e0cba)],shared=False,stateful=True,updated_at=2022-10-16T01:08:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:29.969392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (affcce94-8013-41bd-94da-0e7cb827031f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:29.970126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:29Z,description=,direction='egress',ethertype='IPv4',id=2626621f-ea00-4fc2-9159-b04ee14f105b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34db4209796f4261aa01c1f0175e0da0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=affcce94-8013-41bd-94da-0e7cb827031f,updated_at=2022-10-16T01:08:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:29.970597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2626621f-ea00-4fc2-9159-b04ee14f105b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:29.971035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:29.971889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:29Z,description=,direction='ingress',ethertype='IPv6',id=2b60abc6-ece0-485a-bc44-3018c6d49041,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34db4209796f4261aa01c1f0175e0da0',protocol=,remote_address_group_id=,remote_group_id=affcce94-8013-41bd-94da-0e7cb827031f,remote_ip_prefix=,revision_number=0,security_group_id=affcce94-8013-41bd-94da-0e7cb827031f,updated_at=2022-10-16T01:08:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:29.972394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2b60abc6-ece0-485a-bc44-3018c6d49041), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:29.972745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:29.973451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:29Z,description=,direction='ingress',ethertype='IPv4',id=2c116c67-2b5c-44b6-b460-604143f8bf86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34db4209796f4261aa01c1f0175e0da0',protocol=,remote_address_group_id=,remote_group_id=affcce94-8013-41bd-94da-0e7cb827031f,remote_ip_prefix=,revision_number=0,security_group_id=affcce94-8013-41bd-94da-0e7cb827031f,updated_at=2022-10-16T01:08:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:29.973913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2c116c67-2b5c-44b6-b460-604143f8bf86), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:29.974182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:29.974815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:29Z,description=,direction='egress',ethertype='IPv6',id=867971d3-1b74-45c6-bfe9-4ad22d6e0cba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='34db4209796f4261aa01c1f0175e0da0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=affcce94-8013-41bd-94da-0e7cb827031f,updated_at=2022-10-16T01:08:29Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:29.975195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (867971d3-1b74-45c6-bfe9-4ad22d6e0cba), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:29.975522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-12fa9d2b-571d-44b2-9d7f-cc45a539546b admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:30.102700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Resource SecurityGroup deleted: affcce94-8013-41bd-94da-0e7cb827031f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:30.104109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (affcce94-8013-41bd-94da-0e7cb827031f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:30.104620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('affcce94-8013-41bd-94da-0e7cb827031f',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:30.117464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('affcce94-8013-41bd-94da-0e7cb827031f',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:30.117931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Resource SecurityGroupRule deleted: 2626621f-ea00-4fc2-9159-b04ee14f105b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:30.118377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2626621f-ea00-4fc2-9159-b04ee14f105b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:30.119629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:30.120203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Resource SecurityGroupRule deleted: 2b60abc6-ece0-485a-bc44-3018c6d49041 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:30.120554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2b60abc6-ece0-485a-bc44-3018c6d49041), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:30.121242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:30.121990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Resource SecurityGroupRule deleted: 2c116c67-2b5c-44b6-b460-604143f8bf86 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:30.122376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2c116c67-2b5c-44b6-b460-604143f8bf86), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:30.122954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:30.123493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Resource SecurityGroupRule deleted: 867971d3-1b74-45c6-bfe9-4ad22d6e0cba {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:30.123973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (867971d3-1b74-45c6-bfe9-4ad22d6e0cba), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:30.124303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-815d2280-f6cc-4c46-9754-4a2dfaadaaf8 admin admin] Security group rule updated ['affcce94-8013-41bd-94da-0e7cb827031f'] Oct 16 01:08:31.491776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:572 started Oct 16 01:08:31.494412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417092,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=137000000,duration_sec=1178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:31.495118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:31.495483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:31.993177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:08:31Z,description='Default security group',id=378a4d44-478c-4283-93ff-5b6a1bdc2563,is_default=True,name='default',project_id='d9680903f6f54428821707737e370139',revision_number=1,rules=[SecurityGroupRule(4f1ac852-216a-4cab-8f56-ab286e9e718c),SecurityGroupRule(c53aac9d-ceab-4def-b02d-e4316a147517),SecurityGroupRule(eed37e1d-d039-42f1-b979-31446bde05d9),SecurityGroupRule(f8042208-6bf2-40e9-964c-78f1cb993dab)],shared=False,stateful=True,updated_at=2022-10-16T01:08:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:31.993846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (378a4d44-478c-4283-93ff-5b6a1bdc2563), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:31.994726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:31Z,description=,direction='egress',ethertype='IPv6',id=4f1ac852-216a-4cab-8f56-ab286e9e718c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9680903f6f54428821707737e370139',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=378a4d44-478c-4283-93ff-5b6a1bdc2563,updated_at=2022-10-16T01:08:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:31.995123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4f1ac852-216a-4cab-8f56-ab286e9e718c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:31.995585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:31.996290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:31Z,description=,direction='egress',ethertype='IPv4',id=c53aac9d-ceab-4def-b02d-e4316a147517,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9680903f6f54428821707737e370139',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=378a4d44-478c-4283-93ff-5b6a1bdc2563,updated_at=2022-10-16T01:08:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:31.996660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c53aac9d-ceab-4def-b02d-e4316a147517), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:31.996984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:31.997669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:31Z,description=,direction='ingress',ethertype='IPv4',id=eed37e1d-d039-42f1-b979-31446bde05d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9680903f6f54428821707737e370139',protocol=,remote_address_group_id=,remote_group_id=378a4d44-478c-4283-93ff-5b6a1bdc2563,remote_ip_prefix=,revision_number=0,security_group_id=378a4d44-478c-4283-93ff-5b6a1bdc2563,updated_at=2022-10-16T01:08:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:31.998228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (eed37e1d-d039-42f1-b979-31446bde05d9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:31.998556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:31.999232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:31Z,description=,direction='ingress',ethertype='IPv6',id=f8042208-6bf2-40e9-964c-78f1cb993dab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d9680903f6f54428821707737e370139',protocol=,remote_address_group_id=,remote_group_id=378a4d44-478c-4283-93ff-5b6a1bdc2563,remote_ip_prefix=,revision_number=0,security_group_id=378a4d44-478c-4283-93ff-5b6a1bdc2563,updated_at=2022-10-16T01:08:31Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:31.999584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f8042208-6bf2-40e9-964c-78f1cb993dab), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:31.999909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-292cbe55-f5e4-43c8-a770-ad6b853ed6f8 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:32.129091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Resource SecurityGroup deleted: 378a4d44-478c-4283-93ff-5b6a1bdc2563 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.129520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (378a4d44-478c-4283-93ff-5b6a1bdc2563), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.129998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('378a4d44-478c-4283-93ff-5b6a1bdc2563',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:32.143661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('378a4d44-478c-4283-93ff-5b6a1bdc2563',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:32.143958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Resource SecurityGroupRule deleted: 4f1ac852-216a-4cab-8f56-ab286e9e718c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.144329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4f1ac852-216a-4cab-8f56-ab286e9e718c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.144659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:32.145086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Resource SecurityGroupRule deleted: c53aac9d-ceab-4def-b02d-e4316a147517 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.145651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c53aac9d-ceab-4def-b02d-e4316a147517), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.145978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:32.146354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Resource SecurityGroupRule deleted: eed37e1d-d039-42f1-b979-31446bde05d9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.146700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (eed37e1d-d039-42f1-b979-31446bde05d9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.147047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:32.147556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Resource SecurityGroupRule deleted: f8042208-6bf2-40e9-964c-78f1cb993dab {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.147901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f8042208-6bf2-40e9-964c-78f1cb993dab), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.148215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e7a21dcf-3807-42c2-b3f1-16768bd890e0 admin admin] Security group rule updated ['378a4d44-478c-4283-93ff-5b6a1bdc2563'] Oct 16 01:08:32.529973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:08:32Z,description='Default security group',id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,is_default=True,name='default',project_id='f4395f4aa2f1419c8eab0a48979597eb',revision_number=1,rules=[SecurityGroupRule(44f90903-b962-4911-bbec-865aacd9ce33),SecurityGroupRule(5c97d0cf-85c4-4260-99b4-36ccd820c860),SecurityGroupRule(b396e1fe-533d-4f22-873a-30196cc0bab8),SecurityGroupRule(b79831c9-9a85-44c4-acc6-3b20542b8440)],shared=False,stateful=True,updated_at=2022-10-16T01:08:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:32.530588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (b450a66e-8c80-4894-a7a4-f52c5d7cd53b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.531010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:32Z,description=,direction='ingress',ethertype='IPv6',id=44f90903-b962-4911-bbec-865aacd9ce33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f4395f4aa2f1419c8eab0a48979597eb',protocol=,remote_address_group_id=,remote_group_id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,remote_ip_prefix=,revision_number=0,security_group_id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,updated_at=2022-10-16T01:08:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:32.531377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (44f90903-b962-4911-bbec-865aacd9ce33), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.531715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.532390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:32Z,description=,direction='egress',ethertype='IPv4',id=5c97d0cf-85c4-4260-99b4-36ccd820c860,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f4395f4aa2f1419c8eab0a48979597eb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,updated_at=2022-10-16T01:08:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:32.532747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5c97d0cf-85c4-4260-99b4-36ccd820c860), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.533077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.533740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:32Z,description=,direction='ingress',ethertype='IPv4',id=b396e1fe-533d-4f22-873a-30196cc0bab8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f4395f4aa2f1419c8eab0a48979597eb',protocol=,remote_address_group_id=,remote_group_id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,remote_ip_prefix=,revision_number=0,security_group_id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,updated_at=2022-10-16T01:08:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:32.534096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b396e1fe-533d-4f22-873a-30196cc0bab8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.534426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.535103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:08:32Z,description=,direction='egress',ethertype='IPv6',id=b79831c9-9a85-44c4-acc6-3b20542b8440,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f4395f4aa2f1419c8eab0a48979597eb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b450a66e-8c80-4894-a7a4-f52c5d7cd53b,updated_at=2022-10-16T01:08:32Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:08:32.535458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b79831c9-9a85-44c4-acc6-3b20542b8440), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.535782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-4da126c1-66b2-4cf5-9847-bc06ef0249e1 admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.667064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Resource SecurityGroup deleted: b450a66e-8c80-4894-a7a4-f52c5d7cd53b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.667528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (b450a66e-8c80-4894-a7a4-f52c5d7cd53b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.667987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b450a66e-8c80-4894-a7a4-f52c5d7cd53b',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:08:32.682546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b450a66e-8c80-4894-a7a4-f52c5d7cd53b',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:08:32.682992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Resource SecurityGroupRule deleted: 44f90903-b962-4911-bbec-865aacd9ce33 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.683366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (44f90903-b962-4911-bbec-865aacd9ce33), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.683695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.684314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Resource SecurityGroupRule deleted: 5c97d0cf-85c4-4260-99b4-36ccd820c860 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.684670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5c97d0cf-85c4-4260-99b4-36ccd820c860), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.684993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.685384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Resource SecurityGroupRule deleted: b396e1fe-533d-4f22-873a-30196cc0bab8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.685895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b396e1fe-533d-4f22-873a-30196cc0bab8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.686390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:32.686762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Resource SecurityGroupRule deleted: b79831c9-9a85-44c4-acc6-3b20542b8440 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:08:32.687141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b79831c9-9a85-44c4-acc6-3b20542b8440), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:08:32.687458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-e4789315-5ee6-400e-a978-47e03bab1bbf admin admin] Security group rule updated ['b450a66e-8c80-4894-a7a4-f52c5d7cd53b'] Oct 16 01:08:33.492694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:573 started Oct 16 01:08:33.495356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417094,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=138000000,duration_sec=1180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:33.495950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:33.496308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:35.493944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:574 started Oct 16 01:08:35.496495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417096,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=139000000,duration_sec=1182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:35.497187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:35.497581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:37.495147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:575 started Oct 16 01:08:37.497544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417098,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=141000000,duration_sec=1184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:37.498117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:37.498480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:39.496339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:576 started Oct 16 01:08:39.498695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941709a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=142000000,duration_sec=1186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:39.499297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:39.499653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:41.497467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:577 started Oct 16 01:08:41.499963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941709c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=143000000,duration_sec=1188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:41.500535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:41.500896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:43.498817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:578 started Oct 16 01:08:43.501647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941709e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=144000000,duration_sec=1190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:43.502241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:43.502589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:45.499483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:579 started Oct 16 01:08:45.501780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=145000000,duration_sec=1192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:45.502349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:45.502707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:47.500032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:580 started Oct 16 01:08:47.502376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=145000000,duration_sec=1194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:47.502959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:47.503307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:49.501082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:581 started Oct 16 01:08:49.503800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=146000000,duration_sec=1196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:49.504381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:49.504740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:51.502258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:582 started Oct 16 01:08:51.504556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=148000000,duration_sec=1198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:51.505126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:51.505484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:53.503076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:583 started Oct 16 01:08:53.505365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=148000000,duration_sec=1200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:53.505948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:53.506294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:08:55.504427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:584 started Oct 16 01:08:55.506821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=150000000,duration_sec=1202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:55.507415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:55.507747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:57.505470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:585 started Oct 16 01:08:57.507909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=151000000,duration_sec=1204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:57.508478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:57.508830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:08:59.506426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:586 started Oct 16 01:08:59.508841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=152000000,duration_sec=1206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:08:59.509411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:08:59.509764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:01.507748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:587 started Oct 16 01:09:01.510229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=153000000,duration_sec=1208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:01.511236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:01.511603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:03.109034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:02Z,description='Default security group',id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,is_default=True,name='default',project_id='35a285fc9170459395ef7304b4c468d6',revision_number=1,rules=[SecurityGroupRule(0c9ba6ae-6f49-4b27-9749-90080d8577fb),SecurityGroupRule(2e4251a7-fcae-44c7-9260-2504ecdc52a1),SecurityGroupRule(5ea9aa33-41af-4468-bb6b-89227dac5a3c),SecurityGroupRule(73b62058-32d8-4c7b-b879-364c39c9e0df)],shared=False,stateful=True,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.110338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (ef5530ec-edb1-4510-9c25-5c151fe1e2ac), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.110338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='ingress',ethertype='IPv6',id=0c9ba6ae-6f49-4b27-9749-90080d8577fb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35a285fc9170459395ef7304b4c468d6',protocol=,remote_address_group_id=,remote_group_id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,remote_ip_prefix=,revision_number=0,security_group_id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.110686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (0c9ba6ae-6f49-4b27-9749-90080d8577fb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.110809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.111455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='ingress',ethertype='IPv4',id=2e4251a7-fcae-44c7-9260-2504ecdc52a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35a285fc9170459395ef7304b4c468d6',protocol=,remote_address_group_id=,remote_group_id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,remote_ip_prefix=,revision_number=0,security_group_id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.111820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2e4251a7-fcae-44c7-9260-2504ecdc52a1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.112154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.112816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='egress',ethertype='IPv6',id=5ea9aa33-41af-4468-bb6b-89227dac5a3c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35a285fc9170459395ef7304b4c468d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.113176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (5ea9aa33-41af-4468-bb6b-89227dac5a3c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.113508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.114174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='egress',ethertype='IPv4',id=73b62058-32d8-4c7b-b879-364c39c9e0df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='35a285fc9170459395ef7304b4c468d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ef5530ec-edb1-4510-9c25-5c151fe1e2ac,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.114532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (73b62058-32d8-4c7b-b879-364c39c9e0df), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.114887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-be38d49a-49c4-4f8f-b5e2-8255b6b9db11 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.243201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Resource SecurityGroup deleted: ef5530ec-edb1-4510-9c25-5c151fe1e2ac {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.243613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (ef5530ec-edb1-4510-9c25-5c151fe1e2ac), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.244075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ef5530ec-edb1-4510-9c25-5c151fe1e2ac',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:03.258327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ef5530ec-edb1-4510-9c25-5c151fe1e2ac',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:03.258735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Resource SecurityGroupRule deleted: 0c9ba6ae-6f49-4b27-9749-90080d8577fb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.259337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (0c9ba6ae-6f49-4b27-9749-90080d8577fb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.259678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.260099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Resource SecurityGroupRule deleted: 2e4251a7-fcae-44c7-9260-2504ecdc52a1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.260665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2e4251a7-fcae-44c7-9260-2504ecdc52a1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.260991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.261366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Resource SecurityGroupRule deleted: 5ea9aa33-41af-4468-bb6b-89227dac5a3c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.261729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (5ea9aa33-41af-4468-bb6b-89227dac5a3c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.262567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.263022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Resource SecurityGroupRule deleted: 73b62058-32d8-4c7b-b879-364c39c9e0df {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.263373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (73b62058-32d8-4c7b-b879-364c39c9e0df), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.263696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-8a2d5814-ad0e-49dc-a8e1-09949f663d96 admin admin] Security group rule updated ['ef5530ec-edb1-4510-9c25-5c151fe1e2ac'] Oct 16 01:09:03.509380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:588 started Oct 16 01:09:03.512283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=155000000,duration_sec=1210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:03.513435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:03.513797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:09:03.657685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:03Z,description='Default security group',id=7a7ea1c3-0624-42ba-8609-d07e888a1267,is_default=True,name='default',project_id='413fd1eccc34426cbf4341a2f0faa239',revision_number=1,rules=[SecurityGroupRule(2829bb8a-bc89-4f70-998a-42a5f40aaddb),SecurityGroupRule(3643bff5-5596-4457-8ac4-452c00f0e820),SecurityGroupRule(c8fd8dcf-c2bf-47d8-8678-d6b7fb2de5f1),SecurityGroupRule(f8edc209-3db9-439d-992e-8a745a225e70)],shared=False,stateful=True,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.658128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (7a7ea1c3-0624-42ba-8609-d07e888a1267), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.658799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='ingress',ethertype='IPv6',id=2829bb8a-bc89-4f70-998a-42a5f40aaddb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='413fd1eccc34426cbf4341a2f0faa239',protocol=,remote_address_group_id=,remote_group_id=7a7ea1c3-0624-42ba-8609-d07e888a1267,remote_ip_prefix=,revision_number=0,security_group_id=7a7ea1c3-0624-42ba-8609-d07e888a1267,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.659246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (2829bb8a-bc89-4f70-998a-42a5f40aaddb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.659599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.660281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='ingress',ethertype='IPv4',id=3643bff5-5596-4457-8ac4-452c00f0e820,normalized_cidr=None,port_range_max=,port_range_min=,project_id='413fd1eccc34426cbf4341a2f0faa239',protocol=,remote_address_group_id=,remote_group_id=7a7ea1c3-0624-42ba-8609-d07e888a1267,remote_ip_prefix=,revision_number=0,security_group_id=7a7ea1c3-0624-42ba-8609-d07e888a1267,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.660641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3643bff5-5596-4457-8ac4-452c00f0e820), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.660971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.661636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='egress',ethertype='IPv6',id=c8fd8dcf-c2bf-47d8-8678-d6b7fb2de5f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='413fd1eccc34426cbf4341a2f0faa239',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a7ea1c3-0624-42ba-8609-d07e888a1267,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.661990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (c8fd8dcf-c2bf-47d8-8678-d6b7fb2de5f1), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.662324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.663066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:03Z,description=,direction='egress',ethertype='IPv4',id=f8edc209-3db9-439d-992e-8a745a225e70,normalized_cidr=None,port_range_max=,port_range_min=,project_id='413fd1eccc34426cbf4341a2f0faa239',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7a7ea1c3-0624-42ba-8609-d07e888a1267,updated_at=2022-10-16T01:09:03Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:03.663427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f8edc209-3db9-439d-992e-8a745a225e70), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.663757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-a39e2ef2-5d74-4725-8ad7-39b0299c54a1 admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.773356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Resource SecurityGroup deleted: 7a7ea1c3-0624-42ba-8609-d07e888a1267 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.773769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (7a7ea1c3-0624-42ba-8609-d07e888a1267), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.774235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7a7ea1c3-0624-42ba-8609-d07e888a1267',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:03.787737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7a7ea1c3-0624-42ba-8609-d07e888a1267',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:03.788541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Resource SecurityGroupRule deleted: 2829bb8a-bc89-4f70-998a-42a5f40aaddb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.789278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (2829bb8a-bc89-4f70-998a-42a5f40aaddb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.789856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.790533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Resource SecurityGroupRule deleted: 3643bff5-5596-4457-8ac4-452c00f0e820 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.791165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3643bff5-5596-4457-8ac4-452c00f0e820), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.791735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.792382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Resource SecurityGroupRule deleted: c8fd8dcf-c2bf-47d8-8678-d6b7fb2de5f1 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.793009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (c8fd8dcf-c2bf-47d8-8678-d6b7fb2de5f1), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.793620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:03.794255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Resource SecurityGroupRule deleted: f8edc209-3db9-439d-992e-8a745a225e70 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:03.794839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f8edc209-3db9-439d-992e-8a745a225e70), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:03.795418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-3975163a-b01d-4f58-b94d-2cce5f0ae57b admin admin] Security group rule updated ['7a7ea1c3-0624-42ba-8609-d07e888a1267'] Oct 16 01:09:05.510493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:589 started Oct 16 01:09:05.513661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=156000000,duration_sec=1212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:05.514233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:05.514591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:05.993744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:05Z,description='Default security group',id=3cf70877-7775-44fa-806a-51b4f31bae5f,is_default=True,name='default',project_id='3c5315d8d81a4a5387dbe596f2c9178a',revision_number=1,rules=[SecurityGroupRule(34fb9dc9-afc0-4190-b4d9-51c8928e296b),SecurityGroupRule(3edbc465-ac42-48c3-8fdf-a41599813410),SecurityGroupRule(4b01b707-fa94-47bb-a1b5-963781d8d784),SecurityGroupRule(8055e11b-6366-4f82-9592-fd64cf663728)],shared=False,stateful=True,updated_at=2022-10-16T01:09:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:05.994129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (3cf70877-7775-44fa-806a-51b4f31bae5f), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:05.994999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:05Z,description=,direction='ingress',ethertype='IPv4',id=34fb9dc9-afc0-4190-b4d9-51c8928e296b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3c5315d8d81a4a5387dbe596f2c9178a',protocol=,remote_address_group_id=,remote_group_id=3cf70877-7775-44fa-806a-51b4f31bae5f,remote_ip_prefix=,revision_number=0,security_group_id=3cf70877-7775-44fa-806a-51b4f31bae5f,updated_at=2022-10-16T01:09:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:05.995495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (34fb9dc9-afc0-4190-b4d9-51c8928e296b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:05.995843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:05.997146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:05Z,description=,direction='ingress',ethertype='IPv6',id=3edbc465-ac42-48c3-8fdf-a41599813410,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3c5315d8d81a4a5387dbe596f2c9178a',protocol=,remote_address_group_id=,remote_group_id=3cf70877-7775-44fa-806a-51b4f31bae5f,remote_ip_prefix=,revision_number=0,security_group_id=3cf70877-7775-44fa-806a-51b4f31bae5f,updated_at=2022-10-16T01:09:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:05.997509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3edbc465-ac42-48c3-8fdf-a41599813410), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:05.997846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:05.998509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:05Z,description=,direction='egress',ethertype='IPv4',id=4b01b707-fa94-47bb-a1b5-963781d8d784,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3c5315d8d81a4a5387dbe596f2c9178a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3cf70877-7775-44fa-806a-51b4f31bae5f,updated_at=2022-10-16T01:09:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:05.998893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4b01b707-fa94-47bb-a1b5-963781d8d784), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:05.999233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:05.999887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:05Z,description=,direction='egress',ethertype='IPv6',id=8055e11b-6366-4f82-9592-fd64cf663728,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3c5315d8d81a4a5387dbe596f2c9178a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3cf70877-7775-44fa-806a-51b4f31bae5f,updated_at=2022-10-16T01:09:05Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:06.000301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8055e11b-6366-4f82-9592-fd64cf663728), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.000642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-61a5fecf-2103-42af-913d-5bf3454d1c39 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:06.133381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Resource SecurityGroup deleted: 3cf70877-7775-44fa-806a-51b4f31bae5f {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.133766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (3cf70877-7775-44fa-806a-51b4f31bae5f), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.134224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3cf70877-7775-44fa-806a-51b4f31bae5f',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:06.147884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3cf70877-7775-44fa-806a-51b4f31bae5f',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:06.148293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Resource SecurityGroupRule deleted: 34fb9dc9-afc0-4190-b4d9-51c8928e296b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.148669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (34fb9dc9-afc0-4190-b4d9-51c8928e296b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.149008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:06.149392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Resource SecurityGroupRule deleted: 3edbc465-ac42-48c3-8fdf-a41599813410 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.149741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3edbc465-ac42-48c3-8fdf-a41599813410), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.150174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:06.150430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Resource SecurityGroupRule deleted: 4b01b707-fa94-47bb-a1b5-963781d8d784 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.150777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4b01b707-fa94-47bb-a1b5-963781d8d784), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.151143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:06.151539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Resource SecurityGroupRule deleted: 8055e11b-6366-4f82-9592-fd64cf663728 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.151882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8055e11b-6366-4f82-9592-fd64cf663728), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.152240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d8ff2fb3-089c-4966-932f-f18861294b75 admin admin] Security group rule updated ['3cf70877-7775-44fa-806a-51b4f31bae5f'] Oct 16 01:09:06.534843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:06Z,description='Default security group',id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,is_default=True,name='default',project_id='a25b795de8cd43e4a9fdfd31dd3891ff',revision_number=1,rules=[SecurityGroupRule(4419845f-64a9-4764-9c5e-5930e0065db8),SecurityGroupRule(8f3f8e72-7ef0-4256-93a3-5551b8ea93b2),SecurityGroupRule(b525c5d3-9d81-4552-a30d-1cb71688efbb),SecurityGroupRule(ea3c8500-a63b-4b34-832b-a95c7cb48ddb)],shared=False,stateful=True,updated_at=2022-10-16T01:09:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:06.535487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (dc907ad7-3c4f-4902-bab9-52637e3fad4c), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.536029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:06Z,description=,direction='egress',ethertype='IPv4',id=4419845f-64a9-4764-9c5e-5930e0065db8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25b795de8cd43e4a9fdfd31dd3891ff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,updated_at=2022-10-16T01:09:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:06.536466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (4419845f-64a9-4764-9c5e-5930e0065db8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.536877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.537613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:06Z,description=,direction='egress',ethertype='IPv6',id=8f3f8e72-7ef0-4256-93a3-5551b8ea93b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25b795de8cd43e4a9fdfd31dd3891ff',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,updated_at=2022-10-16T01:09:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:06.538045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (8f3f8e72-7ef0-4256-93a3-5551b8ea93b2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.538535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.539254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:06Z,description=,direction='ingress',ethertype='IPv6',id=b525c5d3-9d81-4552-a30d-1cb71688efbb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25b795de8cd43e4a9fdfd31dd3891ff',protocol=,remote_address_group_id=,remote_group_id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,remote_ip_prefix=,revision_number=0,security_group_id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,updated_at=2022-10-16T01:09:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:06.539679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (b525c5d3-9d81-4552-a30d-1cb71688efbb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.540080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.540806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:06Z,description=,direction='ingress',ethertype='IPv4',id=ea3c8500-a63b-4b34-832b-a95c7cb48ddb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a25b795de8cd43e4a9fdfd31dd3891ff',protocol=,remote_address_group_id=,remote_group_id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,remote_ip_prefix=,revision_number=0,security_group_id=dc907ad7-3c4f-4902-bab9-52637e3fad4c,updated_at=2022-10-16T01:09:06Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:06.541231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (ea3c8500-a63b-4b34-832b-a95c7cb48ddb), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.541569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-1f78d8aa-b8cd-4578-9196-16040657c2c3 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.664198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Resource SecurityGroup deleted: dc907ad7-3c4f-4902-bab9-52637e3fad4c {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.664701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (dc907ad7-3c4f-4902-bab9-52637e3fad4c), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.665075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dc907ad7-3c4f-4902-bab9-52637e3fad4c',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:06.678480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dc907ad7-3c4f-4902-bab9-52637e3fad4c',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:06.678918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Resource SecurityGroupRule deleted: 4419845f-64a9-4764-9c5e-5930e0065db8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.679299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (4419845f-64a9-4764-9c5e-5930e0065db8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.679636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.680383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Resource SecurityGroupRule deleted: 8f3f8e72-7ef0-4256-93a3-5551b8ea93b2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.680735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (8f3f8e72-7ef0-4256-93a3-5551b8ea93b2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.681700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.682083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Resource SecurityGroupRule deleted: b525c5d3-9d81-4552-a30d-1cb71688efbb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.682671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (b525c5d3-9d81-4552-a30d-1cb71688efbb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.682967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:06.683375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Resource SecurityGroupRule deleted: ea3c8500-a63b-4b34-832b-a95c7cb48ddb {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:06.684449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (ea3c8500-a63b-4b34-832b-a95c7cb48ddb), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:06.685011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-362e8cf9-32b0-4039-8c1c-22b4942263d8 admin admin] Security group rule updated ['dc907ad7-3c4f-4902-bab9-52637e3fad4c'] Oct 16 01:09:07.512555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:590 started Oct 16 01:09:07.515073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=158000000,duration_sec=1214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:07.515663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:07.516022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:09.512888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:591 started Oct 16 01:09:09.515311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=158000000,duration_sec=1216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:09.515887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:09.516246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:11.514028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:592 started Oct 16 01:09:11.516738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=159000000,duration_sec=1218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:11.517310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:11.517666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:13.515227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:593 started Oct 16 01:09:13.517932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=161000000,duration_sec=1220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:13.518700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:13.519156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:15.009399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:14Z,description='Default security group',id=5988dd46-7a80-4d12-9e57-e023677d8c82,is_default=True,name='default',project_id='fadabd77b39049ce87be1b401cb1e77f',revision_number=1,rules=[SecurityGroupRule(3fb0018c-6794-4d44-838c-93ca74a29e93),SecurityGroupRule(d3251181-fe1e-4e35-802d-1fb68857bd4e),SecurityGroupRule(eb40542e-a5b8-4a8b-9109-5a18b26540f9),SecurityGroupRule(f51ee1bf-c141-4b87-b4e9-ad90d11d2213)],shared=False,stateful=True,updated_at=2022-10-16T01:09:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.010114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (5988dd46-7a80-4d12-9e57-e023677d8c82), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.010806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:14Z,description=,direction='ingress',ethertype='IPv4',id=3fb0018c-6794-4d44-838c-93ca74a29e93,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fadabd77b39049ce87be1b401cb1e77f',protocol=,remote_address_group_id=,remote_group_id=5988dd46-7a80-4d12-9e57-e023677d8c82,remote_ip_prefix=,revision_number=0,security_group_id=5988dd46-7a80-4d12-9e57-e023677d8c82,updated_at=2022-10-16T01:09:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.011272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3fb0018c-6794-4d44-838c-93ca74a29e93), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.011641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.012341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:14Z,description=,direction='ingress',ethertype='IPv6',id=d3251181-fe1e-4e35-802d-1fb68857bd4e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fadabd77b39049ce87be1b401cb1e77f',protocol=,remote_address_group_id=,remote_group_id=5988dd46-7a80-4d12-9e57-e023677d8c82,remote_ip_prefix=,revision_number=0,security_group_id=5988dd46-7a80-4d12-9e57-e023677d8c82,updated_at=2022-10-16T01:09:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.012725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d3251181-fe1e-4e35-802d-1fb68857bd4e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.013655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.014492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:14Z,description=,direction='egress',ethertype='IPv4',id=eb40542e-a5b8-4a8b-9109-5a18b26540f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fadabd77b39049ce87be1b401cb1e77f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5988dd46-7a80-4d12-9e57-e023677d8c82,updated_at=2022-10-16T01:09:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.014849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (eb40542e-a5b8-4a8b-9109-5a18b26540f9), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.015204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.015864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:14Z,description=,direction='egress',ethertype='IPv6',id=f51ee1bf-c141-4b87-b4e9-ad90d11d2213,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fadabd77b39049ce87be1b401cb1e77f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5988dd46-7a80-4d12-9e57-e023677d8c82,updated_at=2022-10-16T01:09:14Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.016216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (f51ee1bf-c141-4b87-b4e9-ad90d11d2213), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.016541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-dbed5270-ae4a-4c2b-96de-17907eb29824 admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.126608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Resource SecurityGroup deleted: 5988dd46-7a80-4d12-9e57-e023677d8c82 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.127015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (5988dd46-7a80-4d12-9e57-e023677d8c82), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.127473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5988dd46-7a80-4d12-9e57-e023677d8c82',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:15.143648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5988dd46-7a80-4d12-9e57-e023677d8c82',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:15.144066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Resource SecurityGroupRule deleted: 3fb0018c-6794-4d44-838c-93ca74a29e93 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.144451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3fb0018c-6794-4d44-838c-93ca74a29e93), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.144798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.145295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Resource SecurityGroupRule deleted: d3251181-fe1e-4e35-802d-1fb68857bd4e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.145660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d3251181-fe1e-4e35-802d-1fb68857bd4e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.145989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.146372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Resource SecurityGroupRule deleted: eb40542e-a5b8-4a8b-9109-5a18b26540f9 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.146725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (eb40542e-a5b8-4a8b-9109-5a18b26540f9), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.147077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.147460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Resource SecurityGroupRule deleted: f51ee1bf-c141-4b87-b4e9-ad90d11d2213 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.148019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (f51ee1bf-c141-4b87-b4e9-ad90d11d2213), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.148354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-27b96e3d-6fbf-4c95-84ee-5edb9fa1792f admin admin] Security group rule updated ['5988dd46-7a80-4d12-9e57-e023677d8c82'] Oct 16 01:09:15.515885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:594 started Oct 16 01:09:15.518326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=161000000,duration_sec=1222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:15.518947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:15.519368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:15.529144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:15Z,description='Default security group',id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,is_default=True,name='default',project_id='5f176ff9cc2c4ea1994594e361801052',revision_number=1,rules=[SecurityGroupRule(10e2a2f6-70d6-40db-82b0-840b4df6e6e8),SecurityGroupRule(1208c470-dffd-4e85-87fd-3919fa70749e),SecurityGroupRule(9939c2e8-5cc6-4816-b9e5-e79f4137edd2),SecurityGroupRule(cf73ce54-6f2e-49cc-a238-cfab85cdeab4)],shared=False,stateful=True,updated_at=2022-10-16T01:09:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.529698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (7db062b6-d969-4731-a53e-1adc9bb1aa6b), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.530334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:15Z,description=,direction='egress',ethertype='IPv6',id=10e2a2f6-70d6-40db-82b0-840b4df6e6e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f176ff9cc2c4ea1994594e361801052',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,updated_at=2022-10-16T01:09:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.530702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (10e2a2f6-70d6-40db-82b0-840b4df6e6e8), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.531120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.531821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:15Z,description=,direction='ingress',ethertype='IPv4',id=1208c470-dffd-4e85-87fd-3919fa70749e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f176ff9cc2c4ea1994594e361801052',protocol=,remote_address_group_id=,remote_group_id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,remote_ip_prefix=,revision_number=0,security_group_id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,updated_at=2022-10-16T01:09:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.532171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (1208c470-dffd-4e85-87fd-3919fa70749e), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.532506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.533173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:15Z,description=,direction='ingress',ethertype='IPv6',id=9939c2e8-5cc6-4816-b9e5-e79f4137edd2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f176ff9cc2c4ea1994594e361801052',protocol=,remote_address_group_id=,remote_group_id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,remote_ip_prefix=,revision_number=0,security_group_id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,updated_at=2022-10-16T01:09:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.533534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (9939c2e8-5cc6-4816-b9e5-e79f4137edd2), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.533866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.534527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:15Z,description=,direction='egress',ethertype='IPv4',id=cf73ce54-6f2e-49cc-a238-cfab85cdeab4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5f176ff9cc2c4ea1994594e361801052',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7db062b6-d969-4731-a53e-1adc9bb1aa6b,updated_at=2022-10-16T01:09:15Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:15.534921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (cf73ce54-6f2e-49cc-a238-cfab85cdeab4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.535249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-c3ca9aea-e189-4da7-b6f6-197239240e30 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.663964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Resource SecurityGroup deleted: 7db062b6-d969-4731-a53e-1adc9bb1aa6b {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.664372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (7db062b6-d969-4731-a53e-1adc9bb1aa6b), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.664837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7db062b6-d969-4731-a53e-1adc9bb1aa6b',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:15.678076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7db062b6-d969-4731-a53e-1adc9bb1aa6b',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:15.678488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Resource SecurityGroupRule deleted: 10e2a2f6-70d6-40db-82b0-840b4df6e6e8 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.678889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (10e2a2f6-70d6-40db-82b0-840b4df6e6e8), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.679230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.679631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Resource SecurityGroupRule deleted: 1208c470-dffd-4e85-87fd-3919fa70749e {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.679982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (1208c470-dffd-4e85-87fd-3919fa70749e), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.680310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.680678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Resource SecurityGroupRule deleted: 9939c2e8-5cc6-4816-b9e5-e79f4137edd2 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.681028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (9939c2e8-5cc6-4816-b9e5-e79f4137edd2), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.681350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:15.681746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Resource SecurityGroupRule deleted: cf73ce54-6f2e-49cc-a238-cfab85cdeab4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:15.682091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (cf73ce54-6f2e-49cc-a238-cfab85cdeab4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:15.682412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-d04cd253-a003-48b6-82e1-4ffa237faa28 admin admin] Security group rule updated ['7db062b6-d969-4731-a53e-1adc9bb1aa6b'] Oct 16 01:09:16.125994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-10-16T01:09:16Z,description='Default security group',id=78f28792-0dcc-493b-bc74-57e3b52706e4,is_default=True,name='default',project_id='6e0679096c8d46e697ed6604c2ae793a',revision_number=1,rules=[SecurityGroupRule(3c9664ce-4ce8-49fd-b14e-20109dc24ea6),SecurityGroupRule(3dab540d-89b4-4e37-90b8-f4dafa2e40c4),SecurityGroupRule(6bd8ddc2-7245-4c99-a058-23eb5e3715c5),SecurityGroupRule(d1940a86-558f-458e-a963-747bb3052293)],shared=False,stateful=True,updated_at=2022-10-16T01:09:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:16.126602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-867211'] for SecurityGroup (78f28792-0dcc-493b-bc74-57e3b52706e4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.127248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:16Z,description=,direction='egress',ethertype='IPv6',id=3c9664ce-4ce8-49fd-b14e-20109dc24ea6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e0679096c8d46e697ed6604c2ae793a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=78f28792-0dcc-493b-bc74-57e3b52706e4,updated_at=2022-10-16T01:09:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:16.127687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3c9664ce-4ce8-49fd-b14e-20109dc24ea6), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.128037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.128731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:16Z,description=,direction='ingress',ethertype='IPv6',id=3dab540d-89b4-4e37-90b8-f4dafa2e40c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e0679096c8d46e697ed6604c2ae793a',protocol=,remote_address_group_id=,remote_group_id=78f28792-0dcc-493b-bc74-57e3b52706e4,remote_ip_prefix=,revision_number=0,security_group_id=78f28792-0dcc-493b-bc74-57e3b52706e4,updated_at=2022-10-16T01:09:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:16.129093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (3dab540d-89b4-4e37-90b8-f4dafa2e40c4), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.129428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.130097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:16Z,description=,direction='egress',ethertype='IPv4',id=6bd8ddc2-7245-4c99-a058-23eb5e3715c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e0679096c8d46e697ed6604c2ae793a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=78f28792-0dcc-493b-bc74-57e3b52706e4,updated_at=2022-10-16T01:09:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:16.130455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (6bd8ddc2-7245-4c99-a058-23eb5e3715c5), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.130788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.131560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-10-16T01:09:16Z,description=,direction='ingress',ethertype='IPv4',id=d1940a86-558f-458e-a963-747bb3052293,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6e0679096c8d46e697ed6604c2ae793a',protocol=,remote_address_group_id=,remote_group_id=78f28792-0dcc-493b-bc74-57e3b52706e4,remote_ip_prefix=,revision_number=0,security_group_id=78f28792-0dcc-493b-bc74-57e3b52706e4,updated_at=2022-10-16T01:09:16Z) {{(pid=105601) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Oct 16 01:09:16.131918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-867246'] for SecurityGroupRule (d1940a86-558f-458e-a963-747bb3052293), after_update {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.132256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-9c35707c-12dd-4b32-9357-17cdd6a33821 admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.260996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Resource SecurityGroup deleted: 78f28792-0dcc-493b-bc74-57e3b52706e4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:16.261387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-867260'] for SecurityGroup (78f28792-0dcc-493b-bc74-57e3b52706e4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.261892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('78f28792-0dcc-493b-bc74-57e3b52706e4',)}} {{(pid=105601) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Oct 16 01:09:16.275494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('78f28792-0dcc-493b-bc74-57e3b52706e4',)))} {{(pid=105601) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Oct 16 01:09:16.276266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Resource SecurityGroupRule deleted: 3c9664ce-4ce8-49fd-b14e-20109dc24ea6 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:16.276643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3c9664ce-4ce8-49fd-b14e-20109dc24ea6), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.276984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.277377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Resource SecurityGroupRule deleted: 3dab540d-89b4-4e37-90b8-f4dafa2e40c4 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:16.277733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (3dab540d-89b4-4e37-90b8-f4dafa2e40c4), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.278060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.279455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Resource SecurityGroupRule deleted: 6bd8ddc2-7245-4c99-a058-23eb5e3715c5 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:16.279841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (6bd8ddc2-7245-4c99-a058-23eb5e3715c5), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.280178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:16.280556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.resource_cache [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Resource SecurityGroupRule deleted: d1940a86-558f-458e-a963-747bb3052293 {{(pid=105601) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Oct 16 01:09:16.280954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron_lib.callbacks.manager [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-867237'] for SecurityGroupRule (d1940a86-558f-458e-a963-747bb3052293), after_delete {{(pid=105601) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Oct 16 01:09:16.281627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.agent.securitygroups_rpc [None req-0db08cdc-8fbf-4b34-97f7-c23718aa0fdb admin admin] Security group rule updated ['78f28792-0dcc-493b-bc74-57e3b52706e4'] Oct 16 01:09:17.517006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:595 started Oct 16 01:09:17.519581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=163000000,duration_sec=1224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:17.520140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:17.520496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:19.517984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:596 started Oct 16 01:09:19.520755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=164000000,duration_sec=1226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:19.521327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:19.521686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:21.519415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:597 started Oct 16 01:09:21.521759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=165000000,duration_sec=1228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:21.522321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:21.522678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:09:23.520971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:598 started Oct 16 01:09:23.523389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=166000000,duration_sec=1230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:23.523958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:23.524315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:25.522477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:599 started Oct 16 01:09:25.525103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=168000000,duration_sec=1232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:25.525676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:25.526036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:27.523518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:600 started Oct 16 01:09:27.525889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=169000000,duration_sec=1234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:27.526458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:27.526808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:09:29.524226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:601 started Oct 16 01:09:29.526638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=170000000,duration_sec=1236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:29.527237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:29.527608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:31.524823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:602 started Oct 16 01:09:31.527254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=170000000,duration_sec=1238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:31.527831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:31.528187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:33.525673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:603 started Oct 16 01:09:33.528441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=171000000,duration_sec=1240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:33.529045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:33.530144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:35.527330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:604 started Oct 16 01:09:35.530234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=173000000,duration_sec=1242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:35.530826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:35.531212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:37.528236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:605 started Oct 16 01:09:37.531030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=174000000,duration_sec=1244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:37.531611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:37.531969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:39.529449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:606 started Oct 16 01:09:39.531886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=175000000,duration_sec=1246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:39.532446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:39.532797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:41.530472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:607 started Oct 16 01:09:41.533369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=176000000,duration_sec=1248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:41.533931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:41.534279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:43.531009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:608 started Oct 16 01:09:43.533456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=176000000,duration_sec=1250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:43.534028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:43.534386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:45.532475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:609 started Oct 16 01:09:45.534911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=178000000,duration_sec=1252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:45.535487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:45.535841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:47.533564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:610 started Oct 16 01:09:47.536359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=179000000,duration_sec=1254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:47.536928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:47.537281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:49.534826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:611 started Oct 16 01:09:49.537610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=181000000,duration_sec=1256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:49.538194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:49.538583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:51.536067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:612 started Oct 16 01:09:51.543156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=186000000,duration_sec=1258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:51.543759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:51.544117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Oct 16 01:09:53.537569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:613 started Oct 16 01:09:53.540009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=183000000,duration_sec=1260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:53.540570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:53.540933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:55.538988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:614 started Oct 16 01:09:55.541408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=184000000,duration_sec=1262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:55.541977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:55.542355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:57.539451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:615 started Oct 16 01:09:57.541836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=185000000,duration_sec=1264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:57.542403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:57.542757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:09:59.540099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:616 started Oct 16 01:09:59.542451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=186000000,duration_sec=1266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:09:59.543090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:09:59.543443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:01.540809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:617 started Oct 16 01:10:01.543275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=186000000,duration_sec=1268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:01.543848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:01.544207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:03.541471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:618 started Oct 16 01:10:03.543884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=187000000,duration_sec=1270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:03.544456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:03.544814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:05.542599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:619 started Oct 16 01:10:05.545098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=188000000,duration_sec=1272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:05.545672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:05.546034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:07.543370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:620 started Oct 16 01:10:07.545763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=189000000,duration_sec=1274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:07.546332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:07.546693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:09.544878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:621 started Oct 16 01:10:09.547326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=190000000,duration_sec=1276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:09.547900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:09.548257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:11.545630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:622 started Oct 16 01:10:11.548389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=191000000,duration_sec=1278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:11.548983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:11.549334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:13.546319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:623 started Oct 16 01:10:13.548844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=192000000,duration_sec=1280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:13.549413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:13.549769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:15.547138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:624 started Oct 16 01:10:15.549507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=193000000,duration_sec=1282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:15.550068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:15.550419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:10:17.548653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:625 started Oct 16 01:10:17.551110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=194000000,duration_sec=1284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:17.551707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:17.552066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:19.549691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:626 started Oct 16 01:10:19.552916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794170fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=195000000,duration_sec=1286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:19.553499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:19.553861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:21.551043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:627 started Oct 16 01:10:21.553500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417100,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=196000000,duration_sec=1288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:21.554077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:21.554441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:23.551827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:628 started Oct 16 01:10:23.554189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417102,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=197000000,duration_sec=1290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:23.554749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:23.555141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:10:25.552993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:629 started Oct 16 01:10:25.555427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417104,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=198000000,duration_sec=1292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:25.555993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:25.556349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:27.553962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:630 started Oct 16 01:10:27.556423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417106,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=199000000,duration_sec=1294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:27.557001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:27.557363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:29.555413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:631 started Oct 16 01:10:29.557878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417108,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=201000000,duration_sec=1296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:29.558454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:29.558814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:31.556680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:632 started Oct 16 01:10:31.559115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941710a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=202000000,duration_sec=1298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:31.559692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:31.560053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:33.558156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:633 started Oct 16 01:10:33.560853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941710c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=204000000,duration_sec=1300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:33.561454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:33.561858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:35.559147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:634 started Oct 16 01:10:35.561522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941710e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=205000000,duration_sec=1302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:35.562094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:35.562450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:37.559960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:635 started Oct 16 01:10:37.562540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417110,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=205000000,duration_sec=1304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:37.563143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:37.563504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:39.560762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:636 started Oct 16 01:10:39.563217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417112,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=206000000,duration_sec=1306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:39.563794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:39.564153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:41.561457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:637 started Oct 16 01:10:41.563840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417114,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=207000000,duration_sec=1308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:41.564424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:41.564772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:10:43.562355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:638 started Oct 16 01:10:43.564824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417116,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=208000000,duration_sec=1310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:43.565399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:43.565756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:45.563693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:639 started Oct 16 01:10:45.566365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417118,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=209000000,duration_sec=1312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:45.566972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:45.567330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:47.564375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:640 started Oct 16 01:10:47.567031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941711a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=210000000,duration_sec=1314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:47.567595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:47.567949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:49.565008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:641 started Oct 16 01:10:49.567739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941711c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=210000000,duration_sec=1316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:49.568929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:49.569263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:10:51.566701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:642 started Oct 16 01:10:51.569955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941711e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=212000000,duration_sec=1318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:51.570554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:51.570934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:53.567591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:643 started Oct 16 01:10:53.570941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417120,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=214000000,duration_sec=1320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:53.571511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:53.571868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:55.568301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:644 started Oct 16 01:10:55.570659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417122,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=214000000,duration_sec=1322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:55.571245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:55.571593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:57.569354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:645 started Oct 16 01:10:57.571831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417124,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=215000000,duration_sec=1324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:57.572404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:57.572762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:10:59.570855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:646 started Oct 16 01:10:59.573246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417126,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=216000000,duration_sec=1326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:10:59.573813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:10:59.574169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:11:01.571449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:647 started Oct 16 01:11:01.573852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417128,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=217000000,duration_sec=1328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:01.574425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:01.574786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:03.572401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:648 started Oct 16 01:11:03.574774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941712a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=218000000,duration_sec=1330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:03.575380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:03.575737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:05.573677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:649 started Oct 16 01:11:05.576086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941712c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=219000000,duration_sec=1332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:05.576657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:05.577010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:07.574717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:650 started Oct 16 01:11:07.577105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941712e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=220000000,duration_sec=1334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:07.577670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:07.578028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:11:09.575785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:651 started Oct 16 01:11:09.578202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417130,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=221000000,duration_sec=1336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:09.578801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:09.579183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:11.577051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:652 started Oct 16 01:11:11.579527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417132,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=222000000,duration_sec=1338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:11.580137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:11.580496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:13.577862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:653 started Oct 16 01:11:13.580302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417134,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=223000000,duration_sec=1340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:13.580872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:13.581233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:15.579136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:654 started Oct 16 01:11:15.581520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417136,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=225000000,duration_sec=1342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:15.582081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:15.582431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:17.580631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:655 started Oct 16 01:11:17.583104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417138,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=226000000,duration_sec=1344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:17.583677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:17.584038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:19.581655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:656 started Oct 16 01:11:19.584082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941713a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=227000000,duration_sec=1346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:19.584698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:19.585665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:21.583164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:657 started Oct 16 01:11:21.585737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941713c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=229000000,duration_sec=1348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:21.586339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:21.586701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:23.584439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:658 started Oct 16 01:11:23.587683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941713e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=231000000,duration_sec=1350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:23.588257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:23.588614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:25.585986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:659 started Oct 16 01:11:25.589097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417140,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=232000000,duration_sec=1352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:25.589700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:25.590059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:27.586858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:660 started Oct 16 01:11:27.589273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417142,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=232000000,duration_sec=1354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:27.589841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:27.590192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:29.587407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:661 started Oct 16 01:11:29.589840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417144,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=233000000,duration_sec=1356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:29.590411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:29.590765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:31.588361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:662 started Oct 16 01:11:31.591482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417146,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=234000000,duration_sec=1358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:31.592211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:31.592662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:33.589575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:663 started Oct 16 01:11:33.592267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417148,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=235000000,duration_sec=1360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:33.592837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:33.593192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:35.591229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:664 started Oct 16 01:11:35.593967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941714a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=237000000,duration_sec=1362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:35.594547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:35.594926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:37.592602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:665 started Oct 16 01:11:37.595318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941714c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=238000000,duration_sec=1364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:37.595924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:37.596283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:39.593705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:666 started Oct 16 01:11:39.596156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941714e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=239000000,duration_sec=1366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:39.596760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:39.597119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:41.595356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:667 started Oct 16 01:11:41.598665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417150,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=241000000,duration_sec=1368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:41.599425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:41.599957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Oct 16 01:11:43.596500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:668 started Oct 16 01:11:43.599072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417152,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=242000000,duration_sec=1370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:43.599632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:43.599979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:45.597662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:669 started Oct 16 01:11:45.600064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417154,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=243000000,duration_sec=1372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:45.600666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:45.601024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:47.599142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:670 started Oct 16 01:11:47.602407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417156,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=245000000,duration_sec=1374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:47.603017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:47.603380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:49.600163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:671 started Oct 16 01:11:49.602520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417158,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=246000000,duration_sec=1376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:49.603181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:49.603540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:51.601676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:672 started Oct 16 01:11:51.604535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941715a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=247000000,duration_sec=1378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:51.605104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:51.605456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:53.602973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:673 started Oct 16 01:11:53.605338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941715c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=248000000,duration_sec=1380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:53.605934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:53.606287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:55.603851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:674 started Oct 16 01:11:55.606214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941715e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=249000000,duration_sec=1382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:55.606789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:55.607190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:57.604684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:675 started Oct 16 01:11:57.607752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417160,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=250000000,duration_sec=1384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:57.608378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:57.608737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:11:59.605741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:676 started Oct 16 01:11:59.608207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417162,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=251000000,duration_sec=1386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:11:59.608788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:11:59.609138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:01.607085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:677 started Oct 16 01:12:01.609488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417164,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=253000000,duration_sec=1388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:01.610089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:01.610458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:03.607901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:678 started Oct 16 01:12:03.610342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417166,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=253000000,duration_sec=1390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:03.610935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:03.611294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:05.609223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:679 started Oct 16 01:12:05.611646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417168,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=255000000,duration_sec=1392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:05.612222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:05.612580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:07.610760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:680 started Oct 16 01:12:07.613149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941716a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=256000000,duration_sec=1394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:07.613713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:07.614064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:12:09.611625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:681 started Oct 16 01:12:09.614042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941716c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=257000000,duration_sec=1396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:09.614614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:09.615013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:11.612421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:682 started Oct 16 01:12:11.615098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941716e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=258000000,duration_sec=1398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:11.615710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:11.616124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:13.613692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:683 started Oct 16 01:12:13.616178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417170,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=259000000,duration_sec=1400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:13.616755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:13.617114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:15.614905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:684 started Oct 16 01:12:15.617269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417172,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=260000000,duration_sec=1402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:15.617877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:15.618236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:17.615698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:685 started Oct 16 01:12:17.618743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417174,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=261000000,duration_sec=1404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:17.619344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:17.619719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:19.617242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:686 started Oct 16 01:12:19.620284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417176,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=263000000,duration_sec=1406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:19.620860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:19.621217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:21.618852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:687 started Oct 16 01:12:21.621582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417178,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=265000000,duration_sec=1408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:21.622148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:21.622503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:23.619373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:688 started Oct 16 01:12:23.622079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941717a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=265000000,duration_sec=1410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:23.622649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:23.623042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:25.620243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:689 started Oct 16 01:12:25.623159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941717c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=266000000,duration_sec=1412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:25.623780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:25.624150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:27.621269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:690 started Oct 16 01:12:27.623735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941717e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=267000000,duration_sec=1414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:27.624308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:27.624663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:29.622674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:691 started Oct 16 01:12:29.625175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417180,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=268000000,duration_sec=1416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:29.625753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:29.626109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:31.623424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:692 started Oct 16 01:12:31.625824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417182,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=269000000,duration_sec=1418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:31.626389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:31.626743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:33.624620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:693 started Oct 16 01:12:33.627079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417184,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=270000000,duration_sec=1420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:33.627656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:33.628016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:35.625525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:694 started Oct 16 01:12:35.628037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417186,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=271000000,duration_sec=1422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:35.629506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:35.629506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:37.626629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:695 started Oct 16 01:12:37.629123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417188,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=272000000,duration_sec=1424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:37.629701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:37.630062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:39.627831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:696 started Oct 16 01:12:39.630262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941718a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=273000000,duration_sec=1426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:39.630836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:39.631232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:41.629285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:697 started Oct 16 01:12:41.632315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941718c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=275000000,duration_sec=1428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:41.632896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:41.633263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:43.630199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:698 started Oct 16 01:12:43.632691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941718e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=276000000,duration_sec=1430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:43.633257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:43.633605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:45.631755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:699 started Oct 16 01:12:45.634686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417190,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=277000000,duration_sec=1432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:45.635446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:45.635841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:47.632421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:700 started Oct 16 01:12:47.634894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417192,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=278000000,duration_sec=1434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:47.635487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:47.635839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:49.633589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:701 started Oct 16 01:12:49.636175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417194,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=279000000,duration_sec=1436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:49.636760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:49.637127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:51.634650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:702 started Oct 16 01:12:51.637188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417196,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=280000000,duration_sec=1438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:51.637751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:51.638099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:53.635942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:703 started Oct 16 01:12:53.638957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x79417198,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=282000000,duration_sec=1440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:53.639541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:53.639915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:55.637070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:704 started Oct 16 01:12:55.640204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941719a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=283000000,duration_sec=1442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:55.640869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:55.641296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:57.638361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:705 started Oct 16 01:12:57.640796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941719c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=284000000,duration_sec=1444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:57.641391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:57.641750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:12:59.638972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:706 started Oct 16 01:12:59.641414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7941719e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=284000000,duration_sec=1446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:12:59.642044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:12:59.642403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:01.639602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:707 started Oct 16 01:13:01.642037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=285000000,duration_sec=1448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:01.642608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:01.643001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:03.640719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:708 started Oct 16 01:13:03.643187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=286000000,duration_sec=1450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:03.643752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:03.644102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:05.641570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:709 started Oct 16 01:13:05.644413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=287000000,duration_sec=1452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:05.644988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:05.645345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:07.643078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:710 started Oct 16 01:13:07.645470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=289000000,duration_sec=1454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:07.646058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:07.646403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:09.643926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:711 started Oct 16 01:13:09.646324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=289000000,duration_sec=1456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:09.646921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:09.647284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:11.644985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:712 started Oct 16 01:13:11.647695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=290000000,duration_sec=1458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:11.648371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:11.648734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:13.645694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:713 started Oct 16 01:13:13.648126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=291000000,duration_sec=1460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:13.648699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:13.649088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:15.646783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:714 started Oct 16 01:13:15.649252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=292000000,duration_sec=1462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:15.649821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:15.650179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:17.648079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:715 started Oct 16 01:13:17.650489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=294000000,duration_sec=1464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:17.651096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:17.651455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:19.649469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:716 started Oct 16 01:13:19.651917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=295000000,duration_sec=1466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:19.652493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:19.652843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:21.650558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:717 started Oct 16 01:13:21.652981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=296000000,duration_sec=1468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:21.653555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:21.653912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:23.651861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:718 started Oct 16 01:13:23.654348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=297000000,duration_sec=1470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:23.654945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:23.655957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:25.652953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:719 started Oct 16 01:13:25.656086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=298000000,duration_sec=1472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:25.656671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:25.657033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:27.654522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:720 started Oct 16 01:13:27.657096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=300000000,duration_sec=1474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:27.657699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:27.658095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:29.656126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:721 started Oct 16 01:13:29.658542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=302000000,duration_sec=1476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:29.659197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:29.659557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:31.657538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:722 started Oct 16 01:13:31.659955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=303000000,duration_sec=1478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:31.660561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:31.660917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:33.659021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:723 started Oct 16 01:13:33.661431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=304000000,duration_sec=1480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:33.662003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:33.662360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:35.660250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:724 started Oct 16 01:13:35.662957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=306000000,duration_sec=1482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:35.663531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:35.663883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:37.661681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:725 started Oct 16 01:13:37.664137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=307000000,duration_sec=1484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:37.664707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:37.665060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:39.662515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:726 started Oct 16 01:13:39.665252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=308000000,duration_sec=1486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:39.665854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:39.666210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:41.663271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:727 started Oct 16 01:13:41.665700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=309000000,duration_sec=1488,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:41.666277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:41.666635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:43.664130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:728 started Oct 16 01:13:43.666711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=310000000,duration_sec=1490,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:43.667312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:43.667673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:45.665064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:729 started Oct 16 01:13:45.667776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=311000000,duration_sec=1492,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:45.668508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:45.668870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:47.666361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:730 started Oct 16 01:13:47.668915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=312000000,duration_sec=1494,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:47.669498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:47.669863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:49.667636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:731 started Oct 16 01:13:49.670033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=313000000,duration_sec=1496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:49.670605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:49.671004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:51.669128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:732 started Oct 16 01:13:51.671759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=315000000,duration_sec=1498,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:51.672360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:51.672715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:53.669932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:733 started Oct 16 01:13:53.672359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=315000000,duration_sec=1500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:53.672919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:53.673269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:55.670725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:734 started Oct 16 01:13:55.673197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=316000000,duration_sec=1502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:55.673766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:55.674121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:13:57.671875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:735 started Oct 16 01:13:57.674257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=317000000,duration_sec=1504,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:57.674814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:57.675191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:13:59.672614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:736 started Oct 16 01:13:59.675168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=318000000,duration_sec=1506,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:13:59.675746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:13:59.676104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:01.673453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:737 started Oct 16 01:14:01.675960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=319000000,duration_sec=1508,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:01.676533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:01.676889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:03.674635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:738 started Oct 16 01:14:03.677147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=320000000,duration_sec=1510,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:03.677717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:03.678121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:05.675478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:739 started Oct 16 01:14:05.677832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=321000000,duration_sec=1512,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:05.678395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:05.678792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:14:07.676194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:740 started Oct 16 01:14:07.678538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=322000000,duration_sec=1514,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:07.679205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:07.679509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Oct 16 01:14:09.677620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:741 started Oct 16 01:14:09.680098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=323000000,duration_sec=1516,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:09.680619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:09.681076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:11.679229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:742 started Oct 16 01:14:11.681930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=325000000,duration_sec=1518,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:11.682508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:11.682889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:13.680180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:743 started Oct 16 01:14:13.682500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=326000000,duration_sec=1520,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:13.683099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:13.683450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:15.680889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:744 started Oct 16 01:14:15.683216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=326000000,duration_sec=1522,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:15.684428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:15.684777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:17.681981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:745 started Oct 16 01:14:17.684571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=327000000,duration_sec=1524,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:17.685118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:17.685505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:19.683158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:746 started Oct 16 01:14:19.686099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=329000000,duration_sec=1526,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:19.686681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:19.687074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:21.684158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:747 started Oct 16 01:14:21.686652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=330000000,duration_sec=1528,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:21.687252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:21.687606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:23.685367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:748 started Oct 16 01:14:23.688056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=331000000,duration_sec=1530,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:23.688626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:23.688983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:25.686844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:749 started Oct 16 01:14:25.689570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=333000000,duration_sec=1532,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:25.690135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:25.690490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Oct 16 01:14:27.687899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:750 started Oct 16 01:14:27.690369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x794171f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16250737307531889450,duration_nsec=333000000,duration_sec=1534,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=105601) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Oct 16 01:14:27.690988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: DEBUG neutron.agent.linux.utils [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 107363. {{(pid=105601) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Oct 16 01:14:27.691351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[105601]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-236e586c-091c-47ef-94dc-4253e2a52692 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004